Note: Descriptions are shown in the official language in which they were submitted.
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
Title
Method And Apparatus For Recycling Electronic Devices
(Docket Number ECO-007PCT)
Technical Field
[0001] The present invention generally relates to recycling of electronic
devices.
More specifically, the present invention relates to a kiosk for visually
analyzing
electronic devices and providing remuneration to an owner for recycling of the
electronic device.
Background Art
[0002] There has been a large increase in the number of electronic devices
used by
the typical consumer. These devices include cell phones, PDA's, mp3 players,
GPS
devices, cameras, beepers, remote controls, cordless phones, calculators, etc.
The
rapid pace at which new technology and models of electronic devices are
introduced
electronic device, but rather just stops using it and begins using the new
device. This
may happen over several generations of such devices.
[0003] In addition to the electronic devices mentioned above, there are
many other
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
2
just throws the device away in normal trash containers, the proper recycling
or safe
disposing of the device is thwarted.
[0004] One particular problem associated with this phenomenon can be
illustrated by
an example of mobile phones. There are more than 3.6 billion mobile phone
users in
the world with an annual growth of 10% per annum. The replacement rate of
mobile
handsets is roughly every 18 months as new models have more features and new
standards evolve. Wireless carriers also offer new phones below cost, or free,
as
incentives to get customers to sign lucrative two-year service contracts
ensuring a
constant build-up of old mobile phones. Old mobile phones and other mobile
devices
(pagers, PDAs) present a growing threat to the environment. As of 2007, there
are
more than 750 million mobile phones waiting to be recycled in the US, either
in
drawers or already in the waste stream. Another 150+ million or so are added
every
year. Once in the waste stream, these devices may leak Lead, Mercury, Cadmium,
Arsenic and other toxic substances into the water supply. Municipalities often
incinerate their waste, instantly putting these toxic elements into the air,
and they
return to earth in rain water. A problem that needs to be solved is to make it
easy and
accessible for the public to recycle or resell their mobile phones and other
recyclable
devices. Two reasons why mobile phones are not being recycled or resold are
difficult
access to recycling or reselling facilities, and secondly security concerns
about the
information stored on the mobile phone. In addition to mobile phones, the same
problems apply to many other electronic devices.
[0005] The prior art has failed to recognize the problems associated with
recycling
mobile phones in a manner that is enticing to a consumer yet financially
rewarding to
the recycler. Further, the prior art has failed to provide an automated means
for
visually inspecting a LCD screen of a mobile phone to determine if the LCD
screen is
damaged. Additionally, the prior art has failed to provide an automated means
for
determining if an electronic device submitted for recycling and remuneration
is
authentic.
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
3
Summary of the Invention
[0006] The present invention enables one to securely recycle, donate, trade-
in, and/or
sell mobile phones in a publicly accessible location. In an embodiment where
mobile
phones are recycled, the invention is used by a mobile phone owner to submit
his/her
mobile phone for recycling via a recycling kiosk and receive compensation in
some
manner. The compensation might be dispersed via cash, voucher, credit or debit
card,
or other magnetic or electronic transaction methods.
[0007] In one embodiment, a method for conducting the collection of
previously used
electronic devices for the purpose of recycling and refurbishing uses a kiosk
in a
publicly accessible location. The kiosk displays one or more transaction
options. The
method further includes interaction between the user and the kiosk display
options
which may include powering the electronic device, testing and optical
scanning,
erasing of the stored data in the electronic device, determination and
acceptance by
consumer of compensation for the electronic device's value. The method may
further
include selection by consumers through interaction with the kiosk a variety of
compensation methods including dispensing of cash, or redeemable voucher via
coupon, or credit card debiting or crediting, electronic donation to user
specified
charity or charities, or other electronic payment methods.
[0008] One aspect of the present invention is a method for analysis of an
electronic
device and financial remuneration to a user for submission of the electronic
device.
The method comprises positioning an electronic device in an inspection area of
a
kiosk; wherein the inspection area has a light. The method further comprises
imaging
a display screen of the electronic device in a deactivated mode. Next, the
method
comprises imaging a display screen of the electronic device in an active mode,
wherein the light is off, to generate an analysis image of the electronic
device. The
method further comprises imaging the display screen of the electronic device
in the
active mode, wherein the light is on, to generate a first image of the
electronic device.
Next, the method comprises subtracting a first image of the electronic device
from the
analysis image of the electronic device to generate a subtraction image of the
electronic device. The subtraction image is compared to the image of the
electronic
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
4
device in a deactivated mode to determine if the display screen of the
electronic
device has any defects and to define an analyzed electronic device. Lastly,
the method
comprises determining a value for the analyzed electronic device. The method
may
also include automatically binning the electronic device after determining the
value of
the analyzed electronic device.
[0009] The kiosk of the method comprises a housing, the housing comprising
a user
interface on an exterior surface of the housing for the user to input
information, an
upper dome and a lower dome, wherein the upper dome and the lower dome
comprise
a plurality of mirrors. The kiosk further comprises an upper chamber camera, a
lower
chamber camera and a transparent surface. The kiosk further comprises a
processor
within the housing and in communication with the at least one camera, the
processor
configured to identify the brand and model number of the electronic device
based on
at least one of the information from the user and the images from the at least
one
camera, the processor configured to determine a financial remuneration value
for the
electronic device.
[00010] Another aspect of the present invention is a method for analysis of an
electronic device and financial remuneration to a user for submission of the
electronic
device. The method comprises positioning an electronic device in an inspection
area
of a kiosk, the inspection area having a camera. The method further comprises
imaging a portion of the electronic device, the portion comprising the
perimeter of the
electronic device, resulting in a perimeter image. The method further
comprises
inspecting the perimeter image of the electronic device obtained by at least
one
camera disposed in the inspection area to determine if a display screen of the
electronic device has any defects and to define an analyzed electronic device.
Lastly
the method comprises determining a value for the analyzed electronic device.
[00011] The kiosk of the method comprises a housing, a user interface on an
exterior
surface of the housing for the user to input information, an upper dome and a
lower
dome, wherein the upper dome and the lower dome comprise a plurality of
mirrors.
The kiosk further comprises an upper chamber camera, a lower chamber camera
and a
transparent surface. The kiosk also comprises a processor within the housing
and in
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
communication with the at least one camera, the processor configured to
identify the
brand and model number of the electronic device based on at least one of the
information from the user and the images from the at least one camera, the
processor
configured to determine a financial remuneration value for the electronic
device.
5[00012] The method further includes wherein information from the perimeter
image
includes a model name and location of a LED aperture. Additionally, the
processor is
configured to automatically adjust to a rectangular shape for the perimeter
image. The
perimeter image comprises a 360 degree image. Information from the perimeter
image
comprises a location of a USB port, a location of the volume control buttons,
a
location of the camera button, and a location of the power on and off button.
The
information from the perimeter image also comprises a location of the camera
lens
and a logo of the electronic device.
[00013] Yet another aspect of the present invention is a method for analysis
of an
electronic device and financial remuneration to a user for submission of the
electronic
device. The method comprises positioning an electronic device in an inspection
area
of a kiosk; wherein the inspection area has a light. The method further
comprises
imaging a display screen of the electronic device with lights of the
inspection area
illuminating the display screen of the device. Next, the method comprises
imaging a
display screen of the electronic device with the lights of the inspection area
off, to
generate an analysis image of the electronic device. Next, the method
comprises
subtracting the analysis image of the electronic device from the first image
of the
electronic device to generate a synthesized image of the electronic device.
The
subtraction image is compared to trained images of electronic devices. If the
electronic device is a fake with a picture printed on cardboard underneath the
glass
where the LCD would normally be positioned, and the electronic device is
without
electronic components inside, then when the lights are off there will be
nothing
coming from the screen. By doing some processing on the first image, and
detecting
that it has multiple colors and color variation on the display screen area,
yet it isn't
emitting any light, the method assumes that the electronic device is a fake.
The
method also explicitly trains fake display electronic devices as they usually
have the
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
6
same picture in the LCD area. Lastly, the method comprises determining a value
for
the analyzed electronic device. The method may also include automatically
binning
the electronic device after determining the value of the analyzed electronic
device.
[00014] This method also determines crack detection on the display screen,
which is
related to detecting if the electronic device has multiple color variations.
The method
determines the imaging is not getting actual cracks in the glass confused with
pictures
underneath the glass, so doing some sort of color entropy metric assist in
distinguishing one from the other (cracks in the glass do not give off
multiple
different colors).
10[00015] Yet another aspect of the present invention is a method for analysis
of an
electronic device to determine the authenticity of the electronic device, and
to provide
financial remuneration to a user for submission of the electronic device if
the
electronic device is authentic. The method includes positioning an electronic
device in
an inspection area of a kiosk; wherein the inspection area has a light. The
method
also includes imaging the electronic device wherein the light of the
inspection area is
on to generate a first image. The method also includes imaging the electronic
device
wherein the light of the inspection area is off to generate a second image of
the
electronic device. The method also includes generating a synthesized image of
the
electronic device from the first image and the second image, wherein the
synthesized
image is generated to resemble an image of the electronic device would be with
the
display screen off The method also includes comparing the synthesized image to
a
trained image of a plurality of electronic devices to determine the authentic
of the
electronic device, wherein the train image comprises a display screen utilized
by
unauthentic electronic devices.
25[00016] The method may further include detecting cracks in the display
screen. The
method may also utilize a color entropy metric.
[00017] Yet another aspect of the present invention is a dome shaped
apparatus, the
dome shaped apparatus comprising an upper dome, a lower dome and the upper
and lower dome comprising a plurality of walls, wherein the plurality of walls
are
composed of mirrors. The dome shaped apparatus further comprises a transparent
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
7
surface and at least one camera, the camera capable of obtaining a 360 degree
view of
an electronic device placed within the dome shaped apparatus. The upper dome
preferably comprises an upper chamber camera. The lower dome preferably
comprises a lower chamber camera. Preferably, a combination of the each of the
upper dome and lower dome cameras and the plurality of mirrors allow for an
image
of the device placed on the transparent surface. Preferably, the combination
of the
each of the upper dome and lower dome cameras and the plurality of mirrors
allow for
a 360 degree of the electronic device placed on the transparent surface. Each
of the
upper dome and lower dome cameras are moveable.
Brief Description of the Drawings
[00018] FIG. 1 is a perspective view of a recycling kiosk.
[00019] FIG. lA is a front view of the recycling kiosk of FIG. 1.
[00020] FIG. 1B is an isolated view of a front of the recycling kiosk of FIG.
1.
15[00021] FIG. 1C is an isolated view of a front of the recycling kiosk of
FIG. 1.
[00022] FIG. 2 is an isolated view of an electrical connector wheel.
[00023] FIG. 3 is a perspective view of internal components of a kiosk.
[00024] FIG. 3A is a perspective view of internal components of a kiosk.
[00025] FIG. 3B is a perspective view of internal components of a kiosk.
20[00026] FIG. 3C is a perspective view of internal components of a kiosk.
[00027] FIG. 4 is an isolated view of a phone an inspection plate of a kiosk.
[00028] FIG. 4A is an isolated view of a phone being transferred in the kiosk.
[00029] FIG. 4B is an isolated view of a phone being transferred in the
kiosk.
[00030] FIG. 4C is an isolated view of a phone being binned in the kiosk.
25[00031] FIG. 5 is a block diagram of components of a recycling kiosk.
[00032] FIG. 6 is a block diagram of components of a recycling kiosk.
[00033] FIG. 7 is an isolated view of an inspection area of a kiosk.
[00034] FIG. 8 is an isolated view of a camera in a dome of a kiosk.
[00035] FIG. 9 is an isolated view of a phone in an inspection area of a
kiosk.
30[00036] FIG. 10 is an image of a lit mobile phone (with the lights on).
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
8
[00037] FIG. 11 is an image of a non-lit mobile phone.
[00038] FIG. 12 is an image of a subtraction result of the lit phone and the
non-lit
mobile phone.
[00039] FIG. 13 is an image of a trained image of a mobile phone with the
screen not
on.
[00040] FIG. 14 is a graph of an intensity profile from the top down
demonstrating a
match (the spiking line at 211 is the text area, which is not in the trained
image).
[00041] FIG. 15 is an image of a lit unauthenticated mobile phone (with the
lights of
the inspection area on) displaying a picture printed on cardboard and placed
underneath the display screen glass in place of the LCD.
[00042] FIG. 16 is an image of a non-lit unauthenticated mobile phone (with
the lights
of the inspection area off) displaying nothing.
[00043] FIG. 17 is an image of an authenticated mobile phone having cracks in
the
display screen.
15[00044] FIG. 18 is a flow chart for a method of recycling an electronic
device.
[00045] FIG. 19 is a flow chart for a method of recycling an electronic
device.
[00046] FIG. 20 is a flow chart for a method of recycling an electronic
device.
Best Mode(s) For Carrying Out The Invention
[00047] The invention allows for automatic analysis of an electronic device to
determine if the device damaged in order to ascertain a value for recycling
the
electronic device. The automatic analysis is preferably performed utilizing a
kiosk or
recycling machine. The kiosk has an inspection area with an upper chamber and
a
lower chamber. Preferably each chamber has a camera. The kiosk also has a
transparent plate between the inspection area to allow for viewing the bottom
of an
electronic device placed on the transparent plate. Each chamber preferably has
multiple mirrors to provide multiple views of an electronic device within the
inspection area. The mirrors allow for obtaining a multi-dimensional view of
an
electronic device placed on the transparent plate. Preferably, the mirrors
allow for
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
9
obtaining a 360 degree view of an electronic device placed on a rotatable
transparent
plate. Preferably, the mirrors allow for determining a height, width and/or
length of
an electronic device.
[00048] Mobile phones are preferably partitioned into three basic shapes: 1) a
flip
phone or clam shell type such as the MOTOROLA RAZR; 2) a slider phone which
exposes a keyboard or screen such as the MOTORLA DROID; and 3) a bar shape
phone such as the Apple iPHONE or the Research in Motion BLACKBERRY. The
invention is also utilized with a network of kiosks in public spaces that
perform a
combination of recycling processing steps that receive, identify, visually
inspect,
electrically test, electrically erase, grade quality, containerize (bag),
label, and
inventory recyclable electronic devices. Each kiosk determines some form of
compensation to an owner of the device. This compensation is preferably in the
form
of a direct payment, a credit on an account, a donation to a charity, a
discount coupon
for future purchases, or some similar form of compensation. The device owner
has
the choice to accept the offered compensation or reverse the transaction and
retrieve
the device.
[00049] In the following description, an example is given with respect to
mobile
phones. However, those skilled in the pertinent art will recognize that the
system can
be implemented with any number of other devices that have a LCD screen,
without
departing from the spirit and scope of the system.
[00050] As shown in FIGS. 1, 1A, 1B and 1C, a kiosk for recycling electronic
devices
and providing financial remuneration is generally designated 100. The
electronic
device may be a Smart Phone, mobile phone, tablet computer, IPODO device, MP3
Player, GPS device, e-reader, etc. The kiosk 100 has a housing 105 in a pseudo-
rectangular cube shape. The kiosk 100 is preferably of a typical size and
shape of a
vending machine, such as a soda machine, coin changing machine, can recycling
machine, or other vending machines A header 103 allows for marketing and
videos.
An access door 130 in a front body area 131 provides access to an inspection
area 106
for electronic devices. The front of the housing 105 has a display screen 115
for
providing information to a user, and acts as a user interface in a touch
screen
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
embodiment. The exterior of the housing 105 also preferably has a label
printer 125,
a voucher dispenser 126, a receipt printer 127, and a cash or card dispenser
128. The
exterior housing may also have a thumbprint reader.
[00051] The kiosk 100 allows for automatic visual analysis of an electronic
device to
5 identify the electronic device and to determine electronic device is
damaged in order
to ascertain a value for recycling the electronic device. Further, the kiosk
100 also
allows for electrical analysis of the electronic device. As shown in FIG. 2,
the kiosk
100 comprises a carousel 500 containing a plurality of electrical connectors
505a-
505y. Each of the electrical connectors 505 has a unique connection plug for
10 removable connection to an electronic device. Each of the electrical
connectors 505a-
505y has a cartridge removeably secured in the carousel 500. Thus, new
electrical
connectors 505 can be substituted for older electrical connectors 505.
Further, the
kiosk 100 is designed to allow for automatic removal of the electrical
connector 505
using detachment mechanism 511.
15[00052] As shown in FIGS. 3, 3A, 3B and 3C, the internal mechanism 101 of
the kiosk
100 includes an upper chamber 520, a lower chamber 530, a binning plate 540, a
transparent plate 545, a door 550, a bin 555 and the carousel 500. Preferably,
the
carousel 500 is able to hold approximately 25 electrical connectors 505,
wherein the
electrical connectors 505 are interchangeable to easily adapt to the
variations in USB
and other like connections. As shown in FIG. 3B, a mobile phone 150 is placed
on
the transparent plate 545 and transferred to an inspection area 106 within
upper
chamber 520 and lower chamber 530. Both the upper chamber and the lower
chamber preferably have a bell-like shape. As shown in FIG. 3C, the mobile
phone is
moved between the upper chamber 520 and the lower chamber 530 for visual
analysis. The transparent plate, preferably composed of glass of a transparent
plastic
material, allows for imaging components within the upper chamber 520 and lower
chamber 530 to obtain multiple view images of the mobile phone 150.
Preferably, a
3-D profile of the mobile phone is generated in order to provide visual
analysis for
identification and condition of the mobile phone. Once the visual analysis is
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
11
complete, the transparent plate 545 moves out from between the upper chamber
520
and lower chamber 530.
[00053] FIGS. 4, 4A, 4B, and 4C, show the automatic transport and binning of
an
electronic device 150 within the internal mechanism 101 of the kiosk 100. As
shown
in FIG. 4, the door 550 is lowered to reside above the transparent plate 545,
which is
then moved inward with the mobile phone 150 thereon. As shown in FIG. 4A, as
the
transparent plate 545 is moved inward, the mobile phone is blocked by the door
550
and engages binning plate 540 as the mobile phone begins to fall into an
opening
created by the inward movement of the transparent plate 545. As shown in FIG.
4B,
once the mobile phone is on the binning plate 540, the binning plate 540 is
slowly
lowered on one side to open into the bin 555. As shown in FIG. 4C, the mobile
phone
150 slowly falls through an opening 556 into the bin 555 to secure the mobile
phone
150 and for collection at a later time. The entire process performed at a rate
of speed
to prevent damage to the electronic device being recycled.
15[00054] The kiosk 100 is of a typical size and shape of a vending machine,
such as a
soda machine, coin changing machine, can recycling machine, or other vending
machines. The housing 105 of the kiosk 100 protects the internal mechanism 101
and
secures electronic devices submitted for recycling. The housing 105 is
preferably
constructed of a metal material, such as steel or aluminum, to prevent
authorized
access to the kiosk 100.
[00055] The inspection area 106 is preferably designed to permit a detailed
visual
inspection of an electronic device such as a mobile phone, tablet computer, e-
reader,
MP3 players, PDA. The size of the inspection area 106 is preferably 30
centimeters
("cm") in length, by 30cm in width and 20cm in height. The walls of the
inspection
area are preferably white and/or mirrored to provide imaging of the electronic
device.
[00056] The couplings from the kiosk 100 and to a remote computer are
preferably a
single coupling to a communications network such as the intern& via wired LAN,
wireless LAN, cellular or any other proprietary communications system. The
Kiosk
100 preferably includes a processor 160 for processing the information
obtained from
the mobile phone and for controlling the components of the kiosk 100.
Preferably, the
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
12
processor 160 is a standard personal computer ("PC") or other type of embedded
computer running any operating system such as Linux or MAC OS. The processor
160 is most preferably a small form factor PC with integrated hard disk drive
("HDD"), central processing unit ("CPU") and universal serial bus ("USB")
ports to
communicate with the other components of the kiosk 100. One most preferred CPU
is a DELL PC OPTIPLEX 780. Alternatively, the processing means is a
microprocessor with a standalone motherboard which interfaces to a discrete
HDD,
power supply and the other components of the kiosk 100. The kiosk 100
preferably
includes a memory 161 or other storage device, such as a disk drive, that
stores the
executable applications, test software, databases and other software required
to
operate the recycling kiosk 100.
[00057] The external communication component for the kiosk 100 preferably
includes
a wired Ethernet to provide connection to the internet, or alternatively the
external
communication component includes a wireless modem such as GSM, CDMA, 3G and
4G technologies for data communications.
[00058] As shown in FIGS. 7-9, the visual inspection of an electronic device
such as a
mobile phone 150 in the inspection area 106 is preferably performed by at
least one
camera 610 within the upper chamber 520. The lower chamber 530 also preferably
has at least one camera or other imaging component such as a scanner.
Alternatively,
the visual inspection is performed by multiple cameras. A preferred camera 610
is a 1
megapixel machine vision camera. If a single camera 610 is utilized in the
inspection
area 106, the camera 610 preferably is movable to increase a field of view of
the
inspection area 106 to inspect the electronic device 150 such as a mobile
phone placed
on the transparent plate 545. The camera 161 is preferably movable. Preferably
the
camera 610 is positioned to image a LCD screen 153 of the electronic device
150 to
determine if the LCD screen 153 is damaged. The interior surfaces of the upper
chamber 520 and lower chamber 530 preferably include mirrors 615 in order to
optimize viewing of an electronic device positioned within the inspection area
106.
As shown in FIG. 9, a reflection 150' of a mobile phone 150 is illustrated.
The
camera 610 is also preferably movable to image a data port of the electronic
device to
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
13
determine the type of electrical connector 505 for the electronic device in
order to
perform an electrical analysis of the electronic device. Alternatively, the
entire
interior surfaces of the upper chamber 520 and the lower chamber 530 are
mirrored
for optimization of imaging of the electronic device. The camera(s)
alternatively are
CCD or CMOSS.
[00059] FIG. 6 is a block diagram of the main components of the kiosk 100. A
processor 160 is preferably in communication with the other components of the
kiosk
100. The memory 161 preferably contains a database of information on multiple
mobile phones including images, physical characteristics, prices and other
similar
information. The external communications 167 preferably communicates through a
wireless connection or Ethernet with a network to receive and transmit
information to
a remote site. The power supply 170 is preferably received through a plug-in
connection to a wall outlet. The mechanical components 165 include the
electrical
connector carousel 500, the transparent plate 545, the binning plate 540, the
door 550,
and other similar components. The camera 610 or cameras, electrical
connectors, and
a user interface interact with the processor 160 as discussed above. FIG. 5
illustrates
an internal back of a recycling kiosk 100. As shown a processor 160 is
preferably a
personal computer having a battery backup 170a, a wireless connection 167 for
external communications, an electrical connection 140, a receipt dispenser 104
and a
display screen 115.
[00060] The processor 160 identifies the electronic device 150 submitted for
recycling
using information from the visual inspection and user interface. The processor
160
also determines the proper electrical connector 505 for connection to the data
port of
the electronic device 150 using information obtained during the visual
inspection or
from the user interface. The processor 160 also directs and receives
information from
the electrical analysis of the electronic device 150 performed using the
electrical
connector 505 connected to the data port of the electronic device 150. The
processor
also preferably determines a financial remuneration for the submitted
electronic
device 150 based on the visual inspection, optionally the electrical analysis
and data
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
14
stored in the memory 161 of the kiosk or information provided externally
through the
external communication component 167.
[00061] A flow chart for a preferred recycling method is shown in FIG. 19. At
step
301 a customer elects to sell or recycle an electronic device. The customer
checks to
see if the electronic device is supported for sale/refurbishing from a list on
the screen
of the kiosk. The customer activates the on-screen menu system and either
enters the
phone model directly or goes through a series of menus to determine if the
electronic
device is eligible for sale or only for recycling. At decision block 302 it is
determined
if the electronic device is only available for recycling. If yes, (i.e. it is
not on the list
of electronic device available for reselling) the customer can insert the
electronic
device into receptacle at step 303 and the electronic device falls into bin
112 for
recycling.
[00062] If the electronic device is supported for refurbishment/resale the
customer is
then encouraged to engage the testing/rating operation of the system. At step
304, the
system has determined the correct connector to couple to the electronic
device.
Connectivity options and are not limited to cable, standard or proprietary
connectors,
hard docks, reading removable or external physical memory or other wireless
methods
like WiFi, Bluetooth, RFID, NFC, and the like. At step 305 the electronic
device is
connected and inserted into inspection area 106. If this has been done
correctly, the
customer is given some indication (e.g. a green light) and the system proceeds
to step
306. At step 306 the electronic device is tested for operation using
diagnostics and
operating via, for example, the OMSI interface. The diagnostics preferably
includes
electrical and physical testing including testing the electronic device's
battery, screen,
memory, button functionality and structural integrity.
25[00063] Preferably, the electronic device is imaged and analysis software is
used to
identify scratches, cracks, wear patterns, dents, broken or missing pieces,
inclusion of
features such as lenses, buttons, connectors, badges, labeling and/or
branding.
Identification may be done by image comparison or other similar methods where
the
image taken of the electronic device is normalized and compared to a reference
image. Other inspection methods may be used in conjunction with visual and/or
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
electrical testing including weighing to determine specific weight and use
that data to
further refine verification of manufacturer and verification of exact device
model. In
another embodiment, the photographic image is used to identify the correct
manufacturer and model number/product number. Visual identification could
include
5 any combination of the following: calculations based upon measurement,
physical
(e.g., mm, inches), pixel count or other. Identification based upon electronic
device
dimensions, location/size of buttons, LCD and other physical characteristics.
One
camera or multiple cameras may be used to determine height, width, depth as
needed.
Identification based on OCR (Optical Character Recognition) of identifiers
such as
10 Carrier (for phone and tablet computers), brand, model, serial number,
other
identifiers. Identification based upon barcodes. Consumer may be asked to
orient CE
on its front, back, side and then asked to change orientation as needed.
Consumer may
even be asked to remove CE cover(s), batteries and the like in order to gain
access to
identifiable items, such alphanumeric or barcode data. The kiosk 100 provides
a way
15 to use visual inspection with electrical inspection to identify a
device, determine its
value, and reduce possible fraud.
[00064] In one embodiment, the kiosk 100 communicates with the carrier
associated
with a mobile phone to collect any information that could be germane to the
device,
including, for example, validation or authentication, registered ownership,
account
status, time in service, and the like. In some cases, when the customer's
identification
information does not match the registered owner information, the kiosk 100
automatically contacts the assumed owner in some manner (automated telephone
call,
email, text message, etc.) to alert the owner of the phone of the possible
transaction.
[00065] Another feature of an embodiment of the kiosk 100 is to determine if
there is
personal information on the electronic device. This is determined by the
presence of
data in particular storage registers in the memory (e.g., quick-key stored
numbers) or
by looking at file types (jpegs, mp3's, etc.,), or just assuming all non-
default storage
locations must contain personal data. The customer is offered the chance to
erase the
data from the phone. One option allows the customer to request that the data
be first
downloaded and then sent to a location designated by the customer (e.g., email
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
16
address, website, etc.). In another embodiment, there is a slot for the
customer to
enter a memory card (e.g. USB drive. memory stick, etc.) whereupon the kiosk
100
uploads the data to the memory device. In still another embodiment, the kiosk
100
offers a web location from which the user retrieves the data at some later
time if
desired. In another embodiment, the user elects to have the data placed in
another
electronic device purchased by the customer at the kiosk 100 or in the
location of the
kiosk 100 or some other store. The customer preferably selects a user name and
password to access the system provided storage location.
[00066] Once the value is determined, the value is provided at step 307 to the
kiosk.
The kiosk 100 then offers the customer a price or other remuneration for the
phone
that is typically less than the resale value. At step 311, the kiosk 100
completes any
additional testing and diagnostics of the electronic device, disconnects the
cable from
the electronic device, and prints a receipt for the customer. Transfer of
funds may be
authorized via the kiosk 100 by crediting a customer credit card or account by
dispensing cash, or by dispensing a voucher or coupon. At step 312 the kiosk
100
updates its inventory database and transmits the update via a communications
network
to a kiosk server.
[00067] One preferred method of the present invention is illustrated in the
flow chart
of FIG. 18. The method 1000 begins at block 1001 with a mobile phone 150
positioned within an inspection area, 106 of a kiosk 100 wherein the
inspection area
has a light. The electronic device is imaged in a deactivated mode. At block
1002, the
display screen of the electronic device is imaged, wherein the electronic
device is in
the active mode and the light in the inspection area 106 is turned off,
resulting in an
analysis image of the electronic device. At block 1003, the display screen of
the
electronic device 150 is imaged a second time, however the light in the
inspection
area 106 is turned on, resulting in a first image of the electronic device.
The mobile
phone 150 must have a camera function to be placed within a camera mode. At
block
1004, the first image of the electronic device is subtracted from the analysis
image,
generating a subtraction image of the electronic device. At block 1005, the
subtraction image is compared to image of the electronic device in a
deactivated mode
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
17
to determine if the display screen of the electronic device has any defects
and to
define an analyzed electronic device. At block 1006, the value of the mobile
phone is
determined as discussed in more detail below.
[00068] Preferably, the kiosk 100 of the method comprises a housing 105, the
housing
105 comprising a user interface on an exterior surface of the housing for the
user to
input information, an upper dome and a lower dome, wherein the upper dome and
the
lower dome comprise a plurality of mirrors. The kiosk 100 further comprises an
upper
chamber camera, a lower chamber camera and a transparent surface. The kiosk
100
further comprises a processor 160 within the housing and in communication with
the
at least one camera, the processor 160 configured to identify the brand and
model
number of the electronic device based on at least one of the information from
the user
and the images from the at least one camera, the processor 160 configured to
determine a financial remuneration value for the electronic device.
[00069] The upper and lower domes preferably comprise walls composed of
mirrors.
The dome shaped apparatus further comprises a transparent surface and at least
one
camera, the camera capable of obtaining a multiple views of an electronic
device
placed within the dome shaped apparatus. The upper dome preferably comprises
an
upper chamber camera. The lower dome preferably comprises a lower chamber
camera. Preferably, a combination of each of the upper dome and lower dome
cameras and the plurality of mirrors allow for an image of the device placed
on the
transparent surface. Preferably, the combination of each of the upper dome and
lower
dome cameras and the plurality of mirrors allow for a 360 degree of the
electronic
device placed on the transparent surface. Preferably, each of the upper dome
and
lower dome cameras are moveable.
25[00070] An alternative method of the present invention is illustrated in the
flow chart
of FIG. 20. The method 2000 begins at block 2001 wherein an electronic device
is
placed in an inspection area of a kiosk 100, the inspection area 106 having a
camera.
At block 2002, a portion of the electronic device is imaged, the portion
comprising the
perimeter of the electronic device, resulting in a perimeter image. At block
2003, the
perimeter image of the electronic device obtained by at least one camera
disposed in
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
18
the inspection area is inspected. At block 2004, it is determined if a display
screen of
the electronic device has any defects and to define an analyzed electronic
device. At
block 2005 a value for the analyzed electronic device is determined.
[00071] The information from the perimeter image preferably includes a model
name
and location of a LED aperture. Additionally, the processor 160 is configured
to
automatically adjust the perimeter edge to a rectangular shape, to compensate
for
screen damages that result in distorted image due to blacking out of certain
parts of
the screen. The perimeter image comprises a 360 degree image. Information from
the
perimeter image comprises a location of a USB port, a location of the volume
control
buttons, a location of the camera button, and a location of the power on and
off
button. The information from the perimeter image also comprises a location of
the
camera lens and a logo of the electronic device.
[00072] Preferably, visual inspection and recognition software is utilized by
the kiosk
100 to analyze a mobile phone 150. In one preferred method, a recognition
algorithm
is applied to a specific make and model of a mobile phone 150. The visual
inspection
and recognition software determines the borders of a mobile phone 150 under
inspection to determine the external dimensions of the mobile phone 150. The
external dimensions are utilized to determine a subset of possible mobile
phones from
a master database of mobile phones stored in the memory 161 of the kiosk 100
or
available online to the kiosk 100 using external communications. The visual
inspection and recognition software then preferably uses a set of secondary
and
tertiary features to further distinguish the mobile phone 150. These secondary
and
tertiary features can include placement and size of the display screen,
placements and
size of the keyboard, unique buttons, placement of ports, and other
distinguishing
features. Once an exact make and model of the mobile phone is determined, the
visual inspection and recognition software subtracts an image of the mobile
phone
150 from an image of a perfect mobile phone for the same make and model. The
result of the subtraction is preferably a quantifiable number of pixels that
are
calibrated into categories of broken or missing parts, cracked screen, and
low,
medium or high wear.
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
19
[00073] Alternatively, the visual inspection is performed using neural network
pattern
recognition techniques to identify the mobile phone 150, then filter
algorithms are
utilized to determine defects such as cracked screens. Further, those skilled
in the
pertinent art will recognize that other visual inspection techniques may be
employed
without departing from the scope and spirit of the present invention.
[00074] Further, visual inspection optionally includes obtaining a heat
signature for the
mobile phone 150. One preferred method of obtaining a heat signature of a
mobile
phone 150 is to raster a laser across the mobile phone to characterize a heat
decay
profile of the submitted mobile phone 150. This heat decay profile is then
compared
to a heat decay profile for a perfect sample of the same mobile phone 150. The
heat
decay profile indicates the wear of the external surface of the mobile phone
150,
which is used in calculating the financial remuneration for the mobile phone
150.
[00075] Yet another method of the present invention comprises positioning an
electronic device in an inspection area of a recycling kiosk 100, powering up
the
electronic device and displaying a known image on a LCD screen of the
electronic
device. The known image on the LCD screen of the electronic device is compared
with a stored duplicate of the known image stored on the recycling kiosk to
determine
any defects in the LCD screen of the electronic device and to define an
analyzed
electronic device. The method further comprises determining a value for the
analyzed
electronic device.
[00076] In one embodiment of this method, the known image is a start-up image
for
the carrier of the electronic device. In an alternative embodiment, the known
image is
an image of a national park. The method may further comprise performing an
electrical analysis of the electronic device.
25[00077] The method preferably images the electronic device in whatever state
the
electronic device is in when the electronic device is placed into the kiosk.
Then the
method compares the images to the training database of all the different types
of
electronic devices that have been trained in the past (and all the trained
images are
preferably with their screens off).
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
[00078] The method preferably images more than the display screen of the
electronic
device. The method preferably images everything (some keyboards light up, on
Blackberries for instance) on the electronic device.
[00079] The method preferably subtracts the analysis image from the first
image. The
5 method also preferably multiples the analysis image by a multiplier
factor, to account
for changes in the brightness of the screen. For instance, if the brightness
of the
screen does not change at all between the two images, the multiplier factor is
1. If the
brightness of the screen was 1/2 as bright during the analysis image as
during the "first
image", the analysis image is multiplied by 2 so that the brightness matches
for better
10 subtraction (basically there is a brightness compensation factor to
account for screens
that have auto-brightness that change when the dome light of the kiosk is on
versus
off). This image is the "synthesized" image, because the image is synthesized
in part
with the subtraction. The subtracted image is used synonymously with
synthesized
image.
15[00080] The method preferably compares the subtracted image to all the
different
trained images of electronic devices, to first identify the electronic device,
and then to
analyze defects once the electronic device is identified. But the primary
purpose of
doing the subtraction is to generate an image of what the electronic device
would look
like if its screen was off, because it is preferred to compare that image to
the trained
20 images of electronic devices, which have their screens off, to identify
the electronic
device in the first place. Then, analyzing for defects comes after the
electronic device
is identified (or identified what it might be, which it might be a set of five
or ten
electronic devices that are similar).
[00081] Preferably, images are generated for the electronic device in the
kiosk and
compared to training data to identify the electronic device and determine the
condition of all its features.
[00082] In another embodiment, there are two steps to processing: 1) obtain
the
silhouette images to determine where the electronic device is in the kiosk and
the size
of the electronic device (including the side view, the size of the sides of
the electronic
device, etc); 2) obtain the fully lit images and "map the texture" of the
electronic
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
21
device across the silhouette images to determine what the electronic device
actually
looks like when the electronic device is surrounded by light, instead of just
the
silhouette.
[00083] In one embodiment, the mirrors are only a small section of the walls
of the
chamber. Most of the walls are preferably white plastic/paint, made to diffuse
the
light to create uniform lighting, and minimize specular reflections.
[00084] In a preferred kiosk, five of the six faces of the electronic device
are seen. The
top camera sees the front of the electronic device and three of its sides
(left, top,
right), and the bottom camera sees the back of the electronic device. The part
of the
electronic device at the bottom (on an IPHONE phone, where the cable connector
is)
isn't visible because there only have three mirrors, not four. So the
combination of
both cameras sees five of the six sides, and the top camera only sees four of
the six
sides. The location, size, shape and color of all the buttons, regardless of
the function,
are imaged. For example, the IPHONE 4S mobile phonet looks identical to the
VERIZON IPHONE 4 mobile phone, except that it has a SIM card slot on the side.
So the kiosk 100 uses the presence of that SIM card slot to determine that the
electronic device is an IPHONE 4S mobile phone, and not an VERIZON IPHONE 4
mobile phone.
[00085] The present invention preferably extracts features from the training
images
and stores them in a database, along with other information such as the make
and
model of the electronic device, the area/location of the screen, and other
data.
[00086] The "perimeter image" is preferably not used to detect defects in the
screen.
The present invention analyzes the silhouette (area) of the image to help
identify the
device, because this silhouette provides the dimensions of the phone, and
helps
narrow down the devices in the training database to compare to (no sense
comparing a
big phone to all the small ones.... just compare to other phones of a similar
size).
[00087] FIG. 10 is an image of a mobile phone 150 with the lights on. The
display
screen 153 of the mobile phone is illuminated. Touchscreen buttons 153a-153c
are
visible. On the perimeter of the phone 150 physical buttons 156, 157 and 159
are
visible. FIG. 11 is an image of the phone of FIG. 10 with the lights off The
display
CA 02861423 2014-07-16
WO 2013/116256
PCT/US2013/023717
22
screen 153 is barely visible. FIG. 12 is a subtraction result of the image of
the phone
150 with the lights on subtracted from an image of the phone 150 with the
lights off
FIG. 13 is an image of a phone with the display screen 153 off FIG. 14 is a
line
intensity profile of the image of FIG. 13 (solid line 1401) versus the image
of the
phone 150 of FIG. 12 (dashed line 1402). The spike at time 211 represents the
text
area in FIG. 12.
[00088] Another aspect of the present invention is detection of fake
electronic devices.
As shown in FIG. 15, an image of a lit unauthenticated mobile phone 150 (with
the
lights of the inspection area on) displays a picture printed on cardboard and
placed
underneath the display screen glass 153 in place of the LCD. The image has
many
colors and color variation on the screen area. However, the mobile phone is
not
emitting any light. When the lights of the inspection area are turned off, the
display
screen of the mobile phone 150 displays nothing as shown in FIG. 16. Thus, the
kiosk 150 of the present invention can detect non-authenticated (counterfeit)
electronic devices in an automated manner. Further, the image of a fake phone
is
stored in a database for training since the image is typically used multiple
times. A
fake phone also has no electronics in the housing. Thus, the mass of the phone
would
vary from an authentic phone so if the kiosk 100 was equipped with a weight
scale
another means of detection of fake phones would be possible.
20[00089] Another aspect of the present invention is phone screen crack
detection. As
shown in FIG. 17, an image of an authenticated mobile phone 150 has cracks in
the
display screen 153. The present invention can distinguish between actual
cracks in a
display screen glass as compared to an image with many color variations by
performing a color entropy metric since cracks in the glass will not give off
multiple
different colors.
