Note : Les descriptions sont présentées dans la langue officielle dans laquelle elles ont été soumises.
CA 02806473 2013-01-23
WO 2012/021645 PCT/US2011/047286
METHOD AND APPARATUS FOR STREAMING MEDIA CONTENT USING VARIABLE DURATION MEDIA
SEGMENTS
Field of the Invention
The present invention relates to streaming media content and, in particular,
where
the streaming media content is divided into variable duration media segments
for
transmission.
Background
Streaming media content can be divided into segments having a fixed duration.
Adaptive Bit Rate (ABR) streaming protocols have been also been developed. ABR
is a
method of streaming media content where sequential HTTP progressive downloads
in
which a continuous media program is delivered as a series of sequential media
segments
or chunks. It is these sequential media segments that are known to have a
fixed duration.
FIG. 1 illustrates an overview of some ABR use cases. As shown, the content
owners 102 provide a wide variety of media content that are accessed by
consumers 106.
This media content includes television, cable and other audio/visual
programming that is
provided through traditional channels such as broadcast and cable television
as well as
alternative methods such as via the internet. The content owners and providers
supply the
media content to operators 104 such as broadcast and cable television
operators as well as
other types of data providers through the internet 108 and various wireless
technologies.
These operators provide the streaming of the media content to the end
consumers.
In known ABR techniques 110, the segments that are formed from the streaming
media content are of a fixed duration. This fixed duration, however, may not
be ideal for
streaming all of the media content because of various changes within the media
content.
Thus, at discontinuities in the streaming media content, encoding efficiency
is
compromised. And at boundaries such as between programs or desired ad
insertion
locations, the fixed duration segments do not align properly with the actual
content,
resulting in "gaps" or "overlap" of media content when switching content.
1
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
Alternatives to previously used ABR techniques have proposed to alter the
fixed
duration of the segments by dividing the media streaming into segments having
different
fixed durations by allowing this parameter to be provisioned or configured
when the
service is created. Nonetheless, each of the segments still has the same
duration even
though the duration of the segments is different than the duration of
previously used
segments. This does not overcome the deficiencies of other ABR methods using
fixed
duration segments.
In view of the foregoing, alternative methods of ABR are needed to better
accommodate performance and distribution needs of the media content and
distributors.
Brief Description of the Figures
The accompanying figures, where like reference numerals refer to identical or
functionally similar elements throughout the separate views and which together
with the
detailed description below are incorporated in and form part of the
specification, serve to
further illustrate various embodiments and to explain various principles and
advantages all
in accordance with the present invention.
FIG. 1 is an illustration of a use case in which adaptive bit control can be
used
when streaming media content as is known in the prior art.
FIG. 2 is an illustration of an approach of delivering adaptive bit control
streaming
media content.
FIG. 3 illustrates an ABR streaming system that utilizes variable duration
segments
in accordance with embodiments of the present invention.
FIG. 4 illustrates an ABR streaming system that utilizes variable duration
segments
according to scene changes in accordance with embodiments of the present
invention.
FIG. 5 illustrates an ABR streaming system that utilizes variable duration
segments
according to ad avails in accordance with embodiments of the present
invention.
FIG. 6 illustrates an ABR streaming system that utilizes variable duration
segments
according to channel changes in accordance with embodiments of the present
invention.
2
CA 02806473 2013-01-23
WO 2012/021645 PCT/US2011/047286
FIG. 7 illustrates an ABR streaming system that utilizes variable duration
segments
according to program information in accordance with embodiments of the present
invention.
FIG. 8 illustrates fixed duration segments with a discontinuity occurring in a
segment according to the prior art.
FIG. 9 illustrates variable duration segments with a discontinuity occurring
at the
end of a segment according to an embodiment of the present invention.
FIG. 10 illustrates fixed duration segments with a scene change discontinuity
occurring in a segment according to the prior art.
FIG. 11 illustrates variable duration segments with a scene change
discontinuity
occurring at the end of a segment according to an embodiment of the present
invention.
FIG. 12 illustrates fixed duration segments with ad avail discontinuities
occurring
in a segment according to the prior art.
FIG. 13 illustrates fixed duration segments with ad avail discontinuities
occurring
in a segment according to the prior art.
FIG. 14 illustrates variable duration segments with ad avail discontinuities
occurring at the end of a segment according to an embodiment of the present
invention.
FIG. 15 illustrates fixed duration segments with a channel change
discontinuity
occurring in a segment according to the prior art.
FIG. 16 illustrates variable duration segments with channel change
discontinuities
occurring at the end of a segment according to an embodiment of the present
invention
FIG. 17 is a flow chart of a method of operation of an adaptive bit rate
system
using variable duration segments according to an embodiment of the present
invention.
FIG. 18 illustrates a use case for variable duration adaptive bit rate
streaming
media content according to an embodiment of the present invention.
FIG. 19 illustrations another use case for variable duration adaptive bit rate
streaming media content according to an embodiment of the present invention.
3
WO 2012/021645 CA 02806473 2013-01-23 PCT/US2011/047286
Skilled artisans will appreciate that elements in the figures are illustrated
for
simplicity and clarity and have not necessarily been drawn to scale. For
example, the
dimensions of some of the elements in the figures may be exaggerated relative
to other
elements to help to improve understanding of embodiments of the present
invention.
Detailed Description
Before describing in detail embodiments that are in accordance with the
present
invention, it should be observed that the embodiments reside primarily in
combinations of
method steps and apparatus components related to method and apparatus related
to
variable duration media segments for streaming media content using adaptive
bit rate
streaming protocols. Accordingly, the apparatus components and method steps
have been
represented where appropriate by conventional symbols in the drawings, showing
only
those specific details that are pertinent to understanding the embodiments of
the present
invention so as not to obscure the disclosure with details that will be
readily apparent to
those of ordinary skill in the art having the benefit of the description
herein.
In this document, relational terms such as first and second, top and bottom,
and the
like may be used solely to distinguish one entity or action from another
entity or action
without necessarily requiring or implying any actual such relationship or
order between
such entities or actions. The terms "comprises," "comprising," or any other
variation
thereof, are intended to cover a non-exclusive inclusion, such that a process,
method,
article, or apparatus that comprises a list of elements does not include only
those elements
but may include other elements not expressly listed or inherent to such
process, method,
article, or apparatus. An element proceeded by "comprises ...a" does not,
without more
constraints, preclude the existence of additional identical elements in the
process, method,
article, or apparatus that comprises the element.
It will be appreciated that embodiments of the invention described herein may
be
comprised of one or more conventional processors and unique stored program
instructions
that control the one or more processors to implement, in conjunction with
certain non-
processor circuits, some, most, or all of the functions of variable duration
media segments
4
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
used in streaming media content as described herein. The non-processor
circuits may
include, but are not limited to, a radio receiver, a radio transmitter, signal
drivers, clock
circuits, power source circuits, and user input devices. As such, these
functions may be
interpreted as steps of a method to perform streaming media content using
variable
duration segments. Alternatively, some or all functions could be implemented
by a state
machine that has no stored program instructions, or in one or more application
specific
integrated circuits (ASICs), in which each function or some combinations of
certain of the
functions are implemented as custom logic. Of course, a combination of the two
approaches could be used. Thus, methods and means for these functions have
been
described herein. Further, it is expected that one of ordinary skill,
notwithstanding
possibly significant effort and many design choices motivated by, for example,
available
time, current technology, and economic considerations, when guided by the
concepts and
principles disclosed herein will be readily capable of generating such
software instructions
and programs and ICs with minimal experimentation.
The present invention relates to a method of streaming media content using
variable duration segments. The method includes streaming media content and
determining appropriate locations to create segment boundaries at what
otherwise may
become discontinuities in the streaming media content. The method divides the
streaming
media content into a plurality of variable duration segments. The first of the
plurality of
variable duration segments may have a duration different from the second of
the plurality
of variable duration segments so that one of the plurality of variable
duration segments
ends at the desired location in the streaming media content. The method also
transmits the
variable duration segments of the streaming media content.
In an embodiment, the segment boundaries or discontinuities are determined in
the
streaming media by analyzing content of the streaming media content for
boundaries
where the streaming media content changes. The boundaries can be determined by
at least
one of: Analyzing the streaming media content for scene change boundaries;
analyzing
the streaming media content for ad avail boundaries; analyzing the streaming
media
content for channel changes, and analyzing the streaming media content for
program
5
CA 02806473 2013-01-23
WO 2012/021645 PCT/US2011/047286
information such as access information. Moreover, the analyzing can be done
using
multiple rates and multiple formats.
In another embodiment, the duration of variable duration segments is figured
out
by determining a duration of the plurality of variable duration segments and
extending or
decreasing the duration of at least one the plurality of variable duration
segments as
compared to the duration of the other variable duration segments so that the
one of
variable duration segments ends at the determined discontinuity in the
streaming media
content.
The streaming media content can be encoded and metadata can be used to signal
start points and endpoints of the variable media segments. The method can also
divide the
streaming media content into a plurality of variable duration segments such
that the
discontinuities are aligned with an endpoint of the one of the plurality of
variable duration
segments. Moreover, the method can determine the best segment duration for the
variable
duration segments.
In addition, an ABR system can be provided that includes a media segmenter.
The
media segmenter divides streaming media content into a plurality of variable
duration
segments wherein a first of the plurality of variable duration segments may
have a
duration different from a second of the plurality of variable duration
segments so that one
of the plurality of variable duration segments ends at a determined
discontinuity in the
streaming media content. The system also can include an encoder for encoding
the
variable duration segments of the streaming media content. In addition, the
system
includes an adaptive bit rate server for storing and transmitting the variable
duration
segments of the streaming media content.
Turning to FIG. 2, there is shown an illustration of an approach to operate an
adaptive bit rate (ABR) streaming protocol system. A client using a device
202, which
can be a mobile device (as shown) such as a cell phone, smart phone, laptop,
netbook or
tablet computer, or a fixed device (not shown) such as a television or desk
top computer
requests a playlist to be streamed to the device. Such a playlist can consist
of an audio or
visual component such as music and video files. The request is made to a
server 204. In
6
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
response to the request, the server 204 provides the playlist to the client as
a series of
URLs or other references to streaming media content. In an embodiment, when
the device
202 requests the playlist from the server 204, the device 202 can predict,
based on various
factors, the available bandwidth that can be used to have the media content
streamed from
the server 204 to the device 202. Based on its knowledge of the available
bandwidth, the
device 202 can request the best segment size to stream the media content. The
request for
the segment size is provided to the server 204. In response to receiving the
request, the
server 204 can acquire the media content in the appropriate size segments and
provide that
to the device 202. As will be explained in more detail below, server 204 can
use variable
duration segments 206 as it streams the media content to the device 202. As
shown, the
duration and bandwidth of the segments can vary from segment to segment.
FIG. 3 illustrates an ABR streaming system 300 that utilizes variable duration
segments to steam media content from a content provider to a consumer or
client. The
media content that is streamed in the system 300 includes both the audio
and/or visual
content as well as all control data that is used to stream the media content
from a content
provider to an end user. The audio/visual content and control data may be used
and
inserted into the streamlining media content by a content provider, an
operator or and end
user device. As understood, the media content can also include any associated
signaling
or metadata carried with the audio/visual content and control data such as,
but not limited
to, closed captions, multiple soundtracks, ad avail markers, program access
markers, etc.
As seen, the ABR streaming system 300 includes an encoder 302, a media
segmenter 304
and an adaptive bit rate server 306. In addition, the content analyzer 308 can
be provided.
The content analyzer 308 is shown as a separate entity but it can also be a
part of the
encoder 302 or the media segmenter 304.
In an embodiment, the encoder 302 can be multirate and multiformat encoder
that
is therefore capable of encoding media content at various different rates and
in different
formats as is required by the media segmenter 304, the ABR server as well as
the content
provider 312 and the device 202. In an embodiment, the ABR server 306 can be a
media
storage and manager device that stores the variable duration segments and
provides the
variable duration segments to clients when they are requested. The encoder can
receive an
7
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
input signal 310 from a content provider 312. The content provider 312 is the
source of
the media content that is streamed to the device 202 by the system 300.
As the encoder is a multirate and multiformat encoder, the encoder 302
receives
the input signal 310 and encodes the input stream using different rates and
different
formats. As shown, each different rate has a different format 314a-n although
it is
understood that different combinations can be used. The result of the encoder
is output
encoded signals 316a-n corresponding to the rate and format combinations of
the encoder.
In an embodiment, the output encoded signals 316a-n are configured by the
encoder as
MPEG transport stream (MPEG TS) signals. These encoded signals 316a-n are
supplied
to the media segmenter that creates the variable duration media segments
signals 318a-n.
The creation of the variable media segments and operation of the media
segmenter is
explained in more detail below. The variable media segment signals 318a-n are
supplied
to the ABR server 306 that also serves as the media storage and manager
entity. In an
embodiment, the media segmenter 304 provides signals that use HTTP protocols
that are
a part of the sequential HTTP downloads that are delivered to the client.
Thus, the
variable media segments signals 318a-n can be HTTP signals. The variable media
segment signals 318a-n are supplied to the ABR server 306 and are converted
into variable
media segments 320a-n. Each of the variable duration segments 320a-n are
stored in the
ABR server 306 so that the ABR server can stream the requested media content
to the
device 202.
The content analyzer 308 is used to analyze the media content to determine
where
discontinuities in the content are. As is understood in the context of this
disclosure,
discontinuities in the content are those places within media content in which
the media
changes. These changes can occur for a variety of reasons, including but not
limited to
scene changes in the media content itself, ad avails that are provided within
the media
stream, which is where an advertisement can be inserted into the media stream,
channel
changes when a client changes from one source of media content to another
source of
media content. Discontinuities can also be designated by content provided
within the
media content at different places separate from such times as scene changes,
ad avails and
channel changes. These discontinuities can be in the form of program access
information
8
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
and other information regarding the content provider, the operator or other
similar
information.
The discontinuities can be used as within the streamed media content to
coincide
with the endpoint of a segment and the start point of the next segment as
needed by the
media segmenter 304. When a discontinuity occurs, it corresponds to a time or
place, e.g.
an end of the scene, when an ad avail is scheduled, a channel has been
changed, in the
streamed media content for the end of variable duration segment. Likewise,
after the
discontinuity, e.g. at the start of new scene, the beginning of an
advertisement when the ad
avail is provided, a channel has changed, for next variable duration segment
to start.
In an embodiment, the content analyzer 308 can be coupled to the encoder 302.
It
is also possible to configure the encoder 302 to incorporate the content
analyzer 308.
When coupled to the encoder the content analyzer provides the media segmenter
304
where the discontinuities are within the encoded signals 316a-n. The media
segmenter
304 then uses the encoded signals with discontinuities to determine the
duration of the
variable duration segments 318a-n that are provided to the ABR server 308. In
another
embodiment, the content analyzer 308 can be coupled to the media segmenter
308, or the
media segmenter 308 is configured with the content analyzer. In this
embodiment, the
media segmenter 308 is provided with or determines the discontinuities that
are then used
to determine the duration of the variable duration segments 318a-n for use by
the ABR
server 308.
In an embodiment described, the media segmenter 304 receives the
discontinuities
from the media content analyzer 308. Alternatively, the media content analyzer
308 of the
media segmenter 304 determines the discontinuities. With the understanding of
the
position within the media content stream of the discontinuities, the media
segmenter can
divide the media content into the plurality of variable duration segments.
Because the
discontinuities can occur at many different places within the media content
stream or at
multiple different times within the media content stream, the duration of each
segment is
not necessarily the same from one segment to the next segment, therefore
creating the
variable duration segments. The start point and end point in the media stream
for each of
the variable duration segments can be designated by the media segmenter 304
using
9
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
metadata. In one embodiment, a standard duration of the media segments is used
for all
but the last segment of the media stream to the discontinuity. The duration of
remaining
the media segment can be extended so that the end point of the last segment
ends when the
discontinuity in the media stream occurs, or the duration can be decreased so
that the end
point of the last segment ends when the discontinuity in the media stream
occurs. In
another embodiment, a different segment within the plurality of segments can
be extended
or decreased so that end point of the last segment of the media stream ends
when the
discontinuity in the media stream occurs. In yet another embodiment, multiple
segments
of the variable duration segments can have different durations so that the end
point of the
last segment ends when the discontinuity in the media stream occurs.
FIGs. 4-7 illustrated different embodiments of an ABR streaming system. FIG. 4
shows an ABR streaming system 400 in which the content analyzer is a scene
change
analyzer 408. Thus, the media segmenter 404 provides the ABR server 406 with
variable
duration segment signals 418a-n where scene changes are used to designate
discontinuities.
FIG. 5 shows an ABR streaming system 500 in which the content analyzer is an
ad avail
analyzer 508. Thus, the media segmenter 504 provides the ABR server 406 with
variable
duration segment signals 518a-n where the presence of ad avails are used to
designate
discontinuities. FIG. 6 shows an ABR streaming system 600 in which the content
analyzer is a channel change analyzer 608. Thus, the media segmenter 604
provides the
ABR server 406 with variable duration segment signals 618a-n where channel
changes
selected by a client are used to designate discontinuities. FIG. 7 shows an
ABR streaming
system 700 in which the content analyzer is a program access information
analyzer 708.
Thus, the media segmenter 704 provides the ABR server 706 with variable
duration
segment signals 418a-n where program access information that is provided in
the media
content by media content providers or operators are used to designate
discontinuities.
FIG. 8 illustrates a prior art rendition of streaming media content 800. As
shown,
each of the segments 802 has the same duration even though the segments may
have
different bandwidths and contain different number of bytes. The ABR streaming
server
804 streams the media content to clients using the fixed duration media
segments 802. In
addition, a discontinuity 806 in the media stream is shown. The discontinuity
806 is
10
CA 02806473 2013-01-23
WO 2012/021645 PCT/US2011/047286
shown during one of the media segments 808. It is possible that the
discontinuity 806
occurs at the end of one media segment and the beginning of another media
segment, but
as a part of the prior art there is no correlation between the duration of a
media segment
within the streaming media content or the start and end points of a media
segment with the
discontinuity within the media content regardless of the reason for the
discontinuity.
FIG. 9 illustrates a rendition of streaming media content 900 when the
discontinuities within the media content are taken into consideration. In this
embodiment,
the ABR server 902 is part of a content aware system. A media analyzer can
determine
the presence of the discontinuity 904 within the media stream 906. As
described above,
the duration of at least one the media segment 908 can be adjusted so that the
end of one
media segment ends at the point in the media stream 906 where the
discontinuity 904
occurs so that the end point of the variable media segment is aligned with the
discontinuity.
The remaining media segments 910 can have the same duration. As seen, the
duration of
media segment 908 is extended so that it ends at the discontinuity. It is
understood,
however, that the duration of the media segments 910 can be adjusted so that
media
segment 908 is decreased as compared to the media segments 910. In addition,
multiple
media segments within the media stream 906 can have different durations.
FIG. 10 is a prior art rendition of streaming media content 1000 that includes
a
discontinuity 1002 when a scene changes during the streaming media content.
The
streaming media content 1000 is provided by ABR streaming server 1004. As
shown,
each of the segments 1006 has the same duration such that the discontinuity
occurs in the
middle of segment 1008. FIG. 11 illustrates streaming media content 1100
wherein the
context-ABR server 1102 determines the time and place of the discontinuity
1104 that
occurs in the media stream 1100 by a scene change. Understanding the position
of the
discontinuity in the streaming media content 1100, the duration of the media
segments can
1106 vary from one segment to another segment. As seen, the duration media
segment
1108 has been extended so that it is longer than the other media segments.
Thus, the end
of media segment 1108 ends when the discontinuity 1104 caused by the scene
change
occurs in the streaming media content so that the end point of the variable
media segment
is aligned with the discontinuity. It is understood that the duration of media
segment 1108
11
CA 02806473 2013-01-23
WO 2012/021645 PCT/US2011/047286
can be decreased as compared to the other segments 1106 in the streaming media
content
1100 depending on the duration of the other segments 1106. In addition, each
of the
media segments 1106, 1108 can have different durations such that the end of
one media
segment coincides with the location of the discontinuity 1104 caused by the
scene change
in the streaming media content.
FIG. 12 is a prior art rendition of streaming media content 1200 that includes
a
discontinuities 1202 in between which an ad avail occurs during the streaming
media
content. The ad avail indicates the places within the streaming media content
that an
advertisement can be inserted into the media content. The streaming media
content 1200
is provided by ABR streaming server 1204. As shown, each of the segments 1206
has the
same duration such that the ad avail discontinuities occur in the middle of
segments 1208.
FIG. 13 illustrates the prior art such that it is unclear when to end the
streaming media
content and to start the advertisements during the ad avail opportunity in
consideration of
when the discontinuities that occur during segments 1208. In addition, it is
unclear when
to end the advertisement and restart the media stream.
FIG. 14 illustrates streaming media content 1400 wherein the context-ABR
server
1402 determines the time and place of the discontinuities 1404 that occurs in
the media
stream 1100 taking into account the ad avails. Understanding the position of
the
discontinuities in the streaming media content 1400, the duration of the media
segments
1406 can vary from one segment to another segment. As seen, the duration media
segment 1408 has been decreased so that it is shorter than the other media
segments. Thus,
the end of media segment 1408 ends when the discontinuity 1404 caused when the
ad
avail occurs in the streaming media content so that the end point of the
variable media
segment is aligned with the discontinuity. It is understood that the duration
of media
segment 1408 can be extended as compared to the other segments 1406 in the
streaming
media content 1400 depending on the duration of the other segments 1406. In
addition,
the duration of the segments of the advertisement during the ad avail can be
adjusted. As
seen, the duration one segment 1407 is increased as compared to the other
segments for
the advertisement. Each of the media segments 1406, 1407, 1408 can also have
different
12
CA 02806473 2013-01-23
WO 2012/021645 PCT/US2011/047286
durations such that the end of one media segment coincides with the location
of the
discontinuities 1404 caused by the use of the ad avail in the streaming media
content.
FIG. 15 is a prior art rendition of streaming media content 1500 that includes
a
discontinuity 1502 caused by a channel change during the streaming media
content. The
streaming media content 1500 is provided by ABR streaming server 1504. As
shown,
each of the segments 1506 has the same duration such that the discontinuity
occurs in the
middle of segment 1508. FIG. 16 illustrates streaming media content 1600
wherein the
context-ABR server 1602 determines the time and place of the discontinuity
1604 that
occurs in the media stream 1600 by a channel change. The channel change is
caused by
the client of the media stream and occurs such that there is time for the
system to modify
the duration of the segments according to the principles described.
Understanding the
position of the discontinuity in the streaming media content 1600, the
duration of the
media segments can 1606 vary from one segment to another segment. As seen, the
duration media segment 1608 has been decreased so that it is shorter than the
other media
segments. Thus, the end of media segment 1608 ends when the discontinuity 1604
caused
by the channel change occurs in the streaming media content so that the end
point of the
variable media segment is aligned with the discontinuity. It is understood
that the duration
of media segment 1608 can be extended or increased as compared to the other
segments
1606 in the streaming media content 1600 depending on the duration of the
other segments
1606. In addition, each of the media segments 1606, 1608 can have different
durations
such that the end of one media segment coincides with the location of the
discontinuity
1604 caused by the scene change in the streaming media content.
FIG. 17 is a flow chart that shows the operation of an ABR system that streams
media content using variable duration segments. The process begins with a
device 202
requesting 1702 content from a media content provider. The media content
provider
supplies the media content to the device by streaming the media content using
variable
duration segments. In order to stream the media content, an encoder encodes
1704 the
streaming media content using known protocols. The encoder can use multirate
and
multiformat encoding.
13
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
The content analyzer reviews the streaming content to determine 1706 the time
and
places within the media content of any discontinuities. The discontinuities
can occur
based on scene changes, channel changes, the insertion of ad avails, program
access
information and any combination of these. In an embodiment, the media content
analyzer
analyzes the streaming media content for the boundaries in the streaming media
content
that are caused by the discontinuities. The boundaries are a result of the
scene changes, ad
avails, channel changes and program access information. Other discontinuities
can be
determined based on the program information that is determined by the content
analyzer.
With the information of where the discontinuities are located within the
streaming
media content, the media segmenter divides 1708 the streaming media content
into a
plurality of variable duration segments. As is understood, at least one of the
variable
media content segments has a duration different from the other of the variable
media
content segments. Thus, the end of a variable media content server ends when
the
discontinuity occurs in the streaming media content server so that the end
point of the
variable media segment is aligned with the discontinuity. The media segmenter
308 can
determine 1712 the best duration for each of the segments. For example, the
discontinuity
can occur because of a scene change in the streaming media content. Thus, the
variable
duration segment that occurs just before the discontinuity can be extended or
decreased as
compared to the duration of the other variable duration segments so that the
end of that
extended/decreased variable media segment is aligned with the discontinuity in
the
streaming media content. The start points and the end points of the variable
media
segments can be designated using metadata, which can be encoded into the
streaming
media content.
The media segmenter provides 1714 the variable duration segments to the ABR
server. The ABR server can store 1716 the variable duration segments. In an
embodiment, a device 202 can predict 1718 the available bandwidth between the
media
server and the device for the transmission of the variable duration segments.
Based on the
available bandwidth, the device may request any of a plurality of the variable
duration
segments to be transmitted from the media server to the device. The media
server
transmits the requested variable duration segments to 1720 to the device 202.
14
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
FIG. 18 illustrates a possible use case for the variable duration segments
provided
by the ABR server. As shown, multirate multiformat encoder 1802 can provide
streaming
media content to a set top box (STB) 1804 that can be provided with a
streaming client.
The encoder 1802 can also provide the streaming media content to an ABR server
1806
using MPEG TS. The ABR server can also receive media content from other
sources
1808, and this content can be provided using HTTP protocols. The ABR server
1806
communicates with a central network 1810 that communicates with streaming
clients 1803
as well as STB 1804, as well as mobile devices, a computer, and suitably
equipped
television. The ABR server provides variable duration segments by determining
the
location of discontinuities in the media content provided by the encoder 1802
and the
sources 1808.
FIG. 19 illustrates another possible use case for variable duration segments
provided by an ABR server. A home adaptive server 1902 provides the variable
duration
segments to various devices including televisions 1904, personal computers
1906, mobile
devices 1908 including WiFi devices and other equipment. The home adaptive
server
1902 receives the streaming media content from a media operator. The home
adaptive
server 1902 determines the location of discontinuities in the streaming media
content.
Those discontinuities can occur from the media content provider, e.g. scene
changes,
program access information, the media operators, e.g. ad avails, or the
devices 1904-1908,
e.g. channel changes. The home adaptive server 1902 then divides the streaming
media
content into a plurality of variable duration segments so that the end of at
least one of the
variable media segments is aligned with the discontinuity.
In the foregoing specification, specific embodiments of the present invention
have
been described. However, one of ordinary skill in the art appreciates that
various
modifications and changes can be made without departing from the scope of the
present
invention as set forth in the claims below. Accordingly, the specification and
figures are
to be regarded in an illustrative rather than a restrictive sense, and all
such modifications
are intended to be included within the scope of present invention. The
benefits,
advantages, solutions to problems, and any element(s) that may cause any
benefit,
advantage, or solution to occur or become more pronounced are not to be
construed as a
15
WO 2012/021645 CA 02806473 2013-01-23PCT/US2011/047286
critical, required, or essential features or elements of any or all the
claims. The invention
is defined solely by the appended claims including any amendments made during
the
pendency of this application and all equivalents of those claims as issued.
16
