Note: Descriptions are shown in the official language in which they were submitted.
iniu tri Industry
CA 02413820 2002-12-10
1 "SYSTEM FOR CUTTING SHAPES PRESET
2 IN A CONTINUOUS STREAM OF SHEET MATERIAL"
3
4
6
7
8
9
FIELD OF THE INVENTION
11 The invention relates to vision and cutting apparatus for cutting shapes
12 preset in a moving sheet of material. In particular, a vision system
recognizes
13 fiducials associated preset shapes of known geometry and a controller
instructs the
14 cutting system to accurately cut the geometry of the shape as the material
passes
thereby.
16
17 BACKGROUND OF THE INVENTION
18 A known method is to advance a finite length of featureless material
19 into a cutting zone, and while the material is stationary, moving a laser
beam about
on a X-Y positioner for cutting a pattern from the material. A numerically-
controlled
21 positioner positions the laser beam over the material in response to a
predetermined
22 known pattern. Once the pattern is cut the conveyor advances to eject the
cut
23 pattern and bring new material into the cutting zone.
24 In Canadian Patent Application published as 2,016,554 in November
11, 1991, a method is disclosed which partially achieves the objective of
increasing
26 the throughput of cut patterns by enabling laser cutting while material is
moving on a
27 conveyor in a continuous manner through a laser cutting zone. This "Cut-on-
the-Fly"
1
CA 02413820 2002-12-10
1 method eliminates the loading and unloading of material from the cutting
zone and it
2 employs efficient movement of the laser cutting head both along the axis of
the
3 moving material as well as across the material. In US Patent 6,294,755 B1,
issued
4 Sept. 25, 2001 to Lacent Technologies Inc., of Edmonton, Alberta, CANADA, it
is
disclosed to further optimize and increase the throughput of cut material by
6 minimizing the time required to move the laser along a continuous path by
7 discretizing the path into geometric moves, pairs of which are joined to
minimize
8 positioner stop and go. Further, ranges of velocities are analyzed for each
discrete
9 move and are adjusted to overlap for fitting a continuous velocity curve
therethrough.
The above techniques have been based upon a substantially uniform
11 material and the pattern exists only in the cutter's numeric storage. In
other words,
12 the pattern can be implemented anywhere on the continuously moving
material.
13 However, in certain instances it is desirable to locate and cut out a shape
which is
14 already printed or otherwise preset in the material. There are a number of
challenges involved in cutting out shapes or patterns whose coordinates in the
16 materials are invariant including: locating where to start cutting and
cutting along the
17 shape's predetermined cut lines or within a certain tolerance thereof. The
above
18 challenges are worsened in the situations where the material is moving
continuously,
19 where the material may skew from the start of cutting to the end of
cutting.
It is known in the clothing and furniture industry to cut patterned
21 materials for later assembly. In such instances, a finite number of
starting positions
22 are known. An example of such technology is as set forth in US 5,975,743 to
23 Bercaits and US 4,905,159 to Loriot. It is known in the art to use a vision
system
24 which may be utilized to locate a starting point, however, to date the
camera of such
vision systems are carried by the cutter and therefore can only be applied
serially; to
2
CA 02413820 2002-12-10
1 seek within a carefully defined area for locating the start point, and then
resetting to
2 begin the cutting process. Another approach to cutting out the shape is to
pre-mark
3 boundaries or cut lines of the shape with identifying markers, then to trace
the
4 marker with a cutter. To applicant's knowledge, the cutting of preset shapes
from a
moving sheet of material has not been achieved in a satisfactory manner.
6 Applicant has not found the abovementioned technologies provide
7 increased accuracy, higher throughput and operation with more sophisticated
8 materials.
9
SUMMARY OF THE INVENTION
11 In some instances it is desirable to cut out shapes that are preset into
12 sheet material. It is the nature of sheet material that a preset shape can
distort,
13 either as a result of the manufacturing process, such as a weaving process,
or during
14 subsequent handling. The nature and extent of the distortion can vary along
the
length of the shape and along the length of the sheet material. Thus, the
shape is
16 only expected to have a predetermined pattern at a particular relative
position in the
17 sheet material. Further, to speed the process, the material can be moved
18 continuously through a cutting system. Prior art approaches are well known
to cut a
19 known pattern anywhere from a blank piece of material. For shapes preset in
material however, one must cut out a pattern at the corresponding and preset
21 coordinates corresponding to the shape on the sheet material.
22 In one embodiment, a vision system is adapted to a cut-on-the-fly
23 cutting system in which the cutting system is concurrently cutting out
shapes based
24 on a previously located fiducial while the vision system looks at or scans
the sheet
material passing thereby for locating one or more subsequent fiducials in the
material
3
CA 02413820 2002-12-10
1 associated with at least one shape, whether it be the same shape or other
shapes.
2 Each shape is preset in sheet material and is associated with a known
geometry or
3 pattern and a fiducial. The fiducials are known in a global coordinate
system such as
4 that associated with the cutting system. The known pattern is cut relative
to the
coordinates of the fiducial for the corresponding preset shape in the sheet
materials
6 as it passes therethrough. Similarly, the vision system and cut-on-the-fly
cutting
7 system can be moved sequentially and substantially continuously over a fixed
bed of
8 sheet material.
9 To match the cutting pattern with the actual location of each preset
shape, and in one embodiment, a stationary vision system looks at sheet
material
11 moving thereunder for locating a first fiducial, and when found, determines
its global
12 coordinates relative to the cutting system. A controller determines the
location of the
13 pattern relative to this first fiducial for superposition therewith.
Accordingly, preset
14 shapes which appear at non-regular intervals in the sheet material or which
are
shifted in coordinates X or in Y can be cut as readily as those in the prior
art which
16 are not fixed in the material at all or which appear predictably at
predetermined
17 intervals.
18 Concurrently, while the vision system continues to locate subsequent
19 fiducials, the cutting system cuts out preset shapes corresponding with the
earlier
located or previous fiducials.
21 In other cases, at least a second fiducial for a shape, or each shape, is
22 provided in the material. The vision system scans the material within its
field of view
23 for a first fiducial and additional fiducials, and when each is found, the
system
24 determines their global coordinates. The controller expects that the second
or
greater number of fiducials should be found at a given incremental coordinates
from
4
CA 02413820 2002-12-10
1 the first fiducial, based upon the shape's known geometry or pattern. The
pattern is
2 adjusted to account for any apparent distortion in the sheet material and
the shape.
3 One adjustment can include a linear stretch to account for either a shorter
shape or a
4 longer shape than the predetermined geometry in the pattern. Another form of
adjustment includes that which adjusts for shapes in the sheet material which
are
6 rotated (material skewed) and shapes which are distorted within the shape
itself
7 (material is bowed and skewed).
8 In another embodiment, efficiency is maintained or increased by
9 changing cutting instructions on-the-fly. Such a situation includes
remapping
patterns to account for distortion or for modifying, omitting or skipping over
cutting
11 one of multiple preset shapes in a nest of shapes in the sheet material.
One can
12 skip over a preset shape occupying a flawed or otherwise defective piece of
material.
13 A particular fiducial could flag the flawed preset shape. Between the
vision system
14 and the cutting system, the cut path and motion profiles for the conveyor
and laser
cutter positioner can be optimized to minimize dry haul, to minimize the
number of
16 moves, to recalculate the cut path in the cutter's bite and to skip pr
otherwise modify
17 out the flawed shape, saving significant positioner time.
18 Real-time calculations for cut line path and motion control may be
19 performed depending on the circumstance. In a direct application of the
known
geometry or pattern to the shapes in the material, a "cookie cutter" case, the
pattern
21 can be simply applied by superposition of the pattern relative to the
preset shape's
22 identified fiducial and then cut the sheet material. In such a
circumstance, one can
23 choose to use a predetermined cut path and predetermined profile for motion
control
24 of the positioner and the conveyor for the sheet material. In another
circumstance,
where at least two fiducials are located for a shape, then a rotation or a
stretch is
5
CA 02413820 2002-12-10
1 determinable and the shape's coordinates can be remapped to the new pattern
2 without affecting the cut line path. Typically, the motion profile is
recalculated. In
3 other circumstances, such as where an extreme case of bow and skew has been
4 detected through the use of a plurality of fiducials, then the cut line path
may no
longer be optimized prompting an adjustment of the cut path and the motion
profile.
6 Accordingly, in a broad aspect, a method is provided for cutting out at
7 least one shape preset in sheet material, each of the at least one preset
shapes
8 having a pattern with predetermined geometry and having at least one
fiducial, each
9 of the at least one fiducials being associated with predetermined
coordinates in the
pattern, comprising: locating one or more previous fiducials in sheet material
moving
11 relative to a vision system and a cutting system; cutting the preset shapes
based on
12 the one or more previous fiducials while concurrently locating one or more
13 subsequent fiducials in the moving sheet material; and substantially
continuously
14 repeating the concurrent processes of cutting and locating the one or more
subsequent fiducials.
16 In a broad apparatus aspect the method above can be implemented
17 using apparatus comprising: a cut on-the-fly cutting system for cutting a
pattern in the
18 sheet material, the cutting system being known in global coordinates; a
vision system
19 for locating global coordinates of at least one fiducial in the sheet
material which
correspond with predetermined coordinates in the pattern; structure for
effecting
21 relative movement substantially continuously between the sheet material and
the
22 vision and cutting systems; means for establishing measures of said
relative
23 movement in global coordinates; and a controller for superimposing the
pattern with
24 the located at least first fiducial, so that the cutting system cuts the
pattern for the
6
CA 02413820 2002-12-10
1 preset shape substantially concurrently while the vision system locates
global
2 coordinates of subsequent at least one fiducial in the sheet material.
3 The apparatus and methodology disclosed herein are applicable to any
4 tool which may be moved quickly about a predefined shape. The shape in the
material may be integrated into the material or placed onto the material.
References
6 herein to "into" and "onto" are synonymous and one or the other is used
singly to
7 avoid repeating each embodiment at each instance but are not intended to be
8 limiting to one or the other. One example of "into" is to substitute or
include or add
9 marker threads into the sheet material. One example of onto is to print a
marker
onto the surface of the material; such a marker providing discriminating
feedback to
11 the vision's system including contrast, magnetic and radioisotope.
12
7
CA 02413820 2002-12-10
1 BRIEF DESCRIPTION OF THE DRAWINGS
2 Figure 1 is a flow chart and corresponding schematic drawings of one
3 embodiment of a system for cutting preset shapes from moving sheet material;
4 Figures 2a,2b are a top view and side view respectively of a vision
system incorporated with a laser cutter cutting system;
6 Figure 3 is a plan view of preset shapes nested in sheet material and
7 which illustrate a variety of problems in exaggerated depiction;
8 Figures 4a and 4b are plan views which illustrate several un-distorted
9 rectangular shapes and some fiducial options;
Figures 5a and 5b are plan views which illustrate two separate preset
11 shapes which have identical patterns and shapes but which are relatively
shifted
12 transversely on the sheet material;
13 Figure 6 is a plan view which illustrates a shape which is rotated from
14 the ideal pattern (dotted lines) but otherwise not distorted;
Figures 7a and 7b are plan views which illustrate two separate preset
16 shapes the first of which is undistorted and the second of which is
stretched
17 longitudinally by an increment on the sheet material
18 Figures 8a and 8b are plan views which illustrate two separate preset
19 shapes in sheet material the first of which is undistorted and has a
superimposed
grid representing rectangular patches and second of which is distorted in both
bow
21 and skew as illustrated by the distorted patches.
22 Figure 9a is a plan view of a complex preset shape which is distorted in
23 both bow and skew compared to the ideal pattern (dotted lines), grid lines
and
24 patches omitted for clarity;
8
CA 02413820 2002-12-10
1 Figures 9b-9d are plan views according to Figure 9a showing
2 rectangular patches associated with four fiducials wherein Figure 9b shows a
plurality
3 of rectangular patches, Figure 9c shows a single rectangular patch and
Figure 9d
4 shows a skewed rectangular patch;
Figure 10 is a flow chart of a process for cutting shapes preset in sheet
6 material and which illustrate several options to adapt to various material
movement
7 and distortion;
8 Figure 11 is a perspective view of one embodiment of the invention
9 adapted to a commercial laser cutting system according to the Lacent 1000
example;
Figure 12 is an end view of the vision system according to the
11 embodiment of Fig. 11;
12 Figure 13 is a schematic of the vision system cooperating with the
13 cutting system to adjust motion control of the PMC and CMC;
14 Figure 14 is a block flow block diagram of the hardware connections
between the vision system, the cutting system and their respective
controllers; and
16 Figure 15 is a flow diagram of one calculation sequence for determining
17 the cut line paths and motion control.
18
9
CA 02413820 2009-12-17
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
Prior art exists for cutting known patterns out of blank sheet material. With
reference to the schematics for a novel system of Fig. 1, where a shape S has
already
been printed, woven, or otherwise preset into material 10, the shape must
first be
located before being cut out with a cutting system 11. The preset shape S has
a pattern
P having predetermined geometry. The pattern P of each shape's geometry is
known in
advance and is stored. Accurate superposition of the application of the
pattern to the
shape.S in the material can be critical to the integrity and acceptability of
the final cut
shape S. The preset shape S is identified in the sheet material 10 using a
vision system
12 which recognizes one or more characteristics, markers or fiducials F for
the material
10. The location of the fiducials F establishes the geometric relationship
between the
preset shape S and the pattern P. The locations at any time of the cutting
system, the
vision system and the sheet material are known in a global coordinate system.
Accordingly, the location to which the cutting pattern P is applied to and cut
from the
sheet material is then known relative to the recognized fiducial F. A cutter
13 of the
cutting system 11 cuts the sheet material 10 along the predetermined pattern
P, located
accurately and thus superimposed over the preset shape S on the sheet
material.
Concurrently, as the cutter is cutting shapes based on previously located
fiducials,
further and subsequent fiducials are located with the vision system.
With reference also to Figs. 2a,2b, embodiments of the cutting system 11
include those set forth in CA published application 2,016,544 to Bailik and in
issued
patent US 6,294,755 to Sawatzky et al. As shown, an embodiment of the cutting
system
11 is illustrated which comprises a material spreader 14 feeding sheet
material past a
pinch roller 15
McCarthy Tetrault LLP DOCS #881320 v. 2
CA 02413820 2002-12-10
1 and onto a endless conveyor 16. The conveyor 16 supports and conveys the
2 material 10 substantially continuously through the cutting system 11. Cut
material is
3 transferred onto a stacker or other collection system (not shown). The
reality of such
4 mechanical apparatus and variability in sheet material is that one must
establish the
location of a preset shape in the material before cutting and even if known,
the
6 geometry of the preset shapes are sometimes but not always in perfect
7 correspondence with the predetermined geometry for the shape's pattern P.
8 Equally applicable is a system in which the vision system and cutting
9 system are moved sequentially and substantially continuously over a sheet of
material. The efficiency of the system is obtained by cutting on-the-fly
having relative
11 substantially continuous relative movement whether the material move past
the
12 vision and cutting system or the vision and cutting systems are moved past
the
13 material. Herein, and associated with particular apparatus described
herein, the
14 sheet material is described as being moved sequentially past the vision and
cutting
systems.
16 Fiducials F may be located anywhere transversely across the expanse
17 of the material 10. To avoid the associated lost of efficiency and
compromises in
18 accuracy by moving around the material seeking fiducials, the vision system
12 is
19 stationary and looks at, stares or scans a longitudinal increment of
substantially the
entire transverse width of the moving sheet material 10 passing thereby. An
effective
21 width of the sheet material includes that incorporating fiducials. If the
transverse
22 location of one or more fiducials is known, then one or more transverse
portions or
23 region of interests can be defined and monitored for reducing recognition
processing
24 overhead.
11
CA 02413820 2002-12-10
1 Some methodologies for detecting fiducials F include processing
2 images of the material and seeking differential contrast between say, a dark
3 crosshair fiducial and a lighter intensity background. Other methods include
the
4 application and detection of fiducials through magnetic, electromagnetic
radiation
spectrum (visible or invisible), and radioisotopes. Other types of fiducial
markers
6 include sensor threads located in the material which are detected using
capacitance,
7 passive systems measuring variations in magnetic field, or active "time
domain"
8 detectors measuring secondary magnetic field from induced eddy current. As
can be
9 seen from some of the examples above, fiducials F may be placed on the
surface of
the material. Note that herein fiducials may be described as being in or on
the sheet
11 material and neither is meant to be limiting. As long as a fiducial is
identifiable, it is
12 not important whether the fiducial is applied by some surface application
technique
13 or incorporated somehow into the sheet material.
14 Herein the label of vision system is to be interpreted broadly as any
system which detects fiducials F in or on the sheet of material 10. Simple
vision
16 based systems include digital cameras and lens for capturing overlapping
and wide
17 fields of view and scanners. Where the vision system applies a sequential
scan of
18 the effective width of the sheet material, the scan time and processing
time are
19 compensated for in determining the global coordinates of any identified
fiducials in
the moving material. For convenience however, and solely to aid in the
description,
21 the vision system 22 is described herein as a conventional light and camera
system
22 distinguishing contrast between the sheet material and marker threads in
the sheet
23 material. Such a system substantially simultaneously processes the
transverse width
24 of the sheet material. For the identification of fiducials, the terms to
look, scan and
detect are used synonymously herein.
12
CA 02413820 2002-12-10
1 With reference to Fig. 3, sheet material 10 typically has a plurality of
2 shapes S preset therein including machine-identifiable fiducials F. The
fiducials F
3 are distinguishable from the background of the sheet material 10 such having
as
4 discrete "marker thread or threads" having identifiable characteristics
woven in the
warp (typically along the direction of movement) and weft (typically
transverse)
6 direction of woven material. One type of sheet material 10 in which accurate
cutting
7 is advantageous is a material having a particular design and where the
shape's
8 pattern is positioned on the material dependent upon the design in the
material.
9 Another example of type of preset shape in material is a one piece woven
fabric
consisting of two layers of fabric joined together at discrete points. The
shape S may
11 be related to the discrete points, including part or all of shape's
internal and external
12 boundaries or allocation of tolerances thereabout. The apparatus and
methodology
13 herein enables accurate cutting of each shape S so as to avoid impinging on
a
14 boundary, typically having a tolerance; else the preset shape S may not
survive the
cutting or a subsequent quality control process.
16 It is to be understood that the preset shape S may not be physically
17 marked on the sheet material 10, but that its geometry and a characteristic
point is
18 known relative to the one or more fiducials. Further, whether marked or
not, the
19 preset shape S is that corresponding to a predetermined pattern P and when
applied
and cut from material may include a tolerance, such as a seam allowance.
21 A nest of a plurality of shapes S are illustrated in Fig. 3, at least some
22 of which are preset shapes S placed into. the material 10. The nest itself
can
23 constitute a preset shape S having a pattern P which is merely more
comprehensive
24 than a pattern P for an individual preset shape S.
13
CA 02413820 2002-12-10
1 For illustrative purposes, some variations in the shapes S have been
2 illustrated including some fanciful and severe distortions. The leading four
preset
3 shapes S are distorted in bow and skew. The second group of preset shapes S
4 includes one shape having a flaw. The last group of four shapes S has a
leading
fiducial F which is non-periodic compared to the other fiducials.
6 As known from Sawatzky et al., to cut any shape, a pattern is
7 characterized by a series of calculated cut lines along which the cutter is
driven.
8 Actual cutting can be optimized by calculating such cut lines on-the-fly.
Accordingly,
9 adapting to variable geometry of preset shapes S benefits from systems
capable of
real time scanning of sheet material 10 and recognition of fiducials F while
11 performing optimization calculations so as to determine and implement the
optimum
12 cutting of the pattern P.
13 The sheet material 10 is moved continuously through the vision and
14 cutting systems. The shapes S are preset in the moving material 10. The
pattern P
for the ideal geometry has been predetermined and is known. The location to
which
16 the pattern P will ultimately be applied to the sheet material 10 is
initially an
17 unknown. The vision system 12 provides this information through the
identification of
18 the coordinates of an associated fiducial. This one fiducial, which becomes
a
19 previous fiducial upon locating subsequent fiducials, enables determination
of the
preset shape S. The use additional subsequent fiducials enable determining
21 distortion. The cutting system 11 is instructed regarding what particular
pattern or
22 geometry applies, and where and when to cut the pattern P so as to be
23 superimposed with the preset shape S regardless of location in the sheet
material 10
24 or distortion. The nature of cut-on the-fly operations already adapts to
the cutting of
moving material 10 and herein is further enabled with the ability to
concurrently
14
CA 02413820 2002-12-10
1 identify fiducials F while cutting of patterns Pat coordinates dictated by
the fiducials.
2 In cut-on the-fly operation, most of the optimization calculations are
performed real-
3 time, at least to translate and rotate coordinates in response to relocating
or
4 positioning of the known pattern P. Accordingly, when one or more reference
coordinates or fiducials of the preset shape S are known, the cutting pattern
P is
6 adapted in real time to be applied and cut precisely superimposed at the
coordinates
7 and geometry of the corresponding shape preset in the material.
8 To enable real-time performance in cut-on-the-fly operations, one
9 cannot merely serially scan over sheet material 10 and later return to cut
the
previously scanned material as the sheet material has already moved on and out
of
11 the cutting zone of the cutting system. Limited only by computing
capabilities, each
12 of the preset shape locating and cutting operations are autonomous and
operate
13 simultaneously or concurrently. Such capabilities result from a vision
system 12
14 located upstream of the cutting system 11.
Means are provided for processing the vision system information and
16 for adapting the information to superimpose and cut a pattern to a preset
shape with
17 the cutting system. In one embodiment as shown, the vision system 12 has a
18 controller 21 for processing the fiducial recognition system information,
and
19 determining coordinates x,y of the fiducials F relative to the cutting
system 11. A
global coordinate system is maintained in which the vision and cutting systems
are
21 known. The coordinates of the sheet material are also known in the global
22 coordinate system as it moves therethrough. An encoder coupled to the means
23 moving the sheet material relative to the vision and cutting systems
provides the
24 geometric relationship between coordinates on the sheet material as it
moves in the
global coordinate system between the vision system and the cutting system.
CA 02413820 2002-12-10
1 Controller means 21, such as computer implemented software, determine the
2 presence and coordinates of recognized fiducials F in the coordinate system
of the
3 cutting system 11 and interface the vision system 12 and cutting system 11
including
4 communicating the information for recognized fiducials F to the cutting
system 11.
The cutting system 11 has its own controller means 22 for processing conveyor
and
6 positioner movement for ultimately cutting a pattern at the preset shape in
the sheet
7 material. The controller operations need not be physically separate but
could also be
8 handled by a consolidated controller or a supervisory controller.
9 Referring to Figs. 4a,4b, as the material moves continuously past the
vision system it locates a fiducial F or a unique sequence of fiducials F',F"
related to
11 a shape. In Fig. 4a a first fiducial F is illustrated by a dot already
related to a
12 rectangular shape S. In Fig. 4b, a series of cross-hair fiducials F',F" are
illustrated;
13 two in sequence may be indicative of an upcoming shape S, the next fiducial
F or
14 fiducials related to a rectangular shape S. A controller "pattern matches"
the known
pattern P and the recognized fiducials F. As previously described, the pattern
P,
16 known by controller means, can be cut from the moving sheet material 10 by
locating
17 and superimposing the pattern P with the fiducial F in the material and
then cutting
18 the pattern P so as to accurate cut the pattern preset shape S. As shown in
Figs.
19 5a,5b, regardless of whether a subsequent shape (Fig. 5b) is shifted on the
sheet
material from a previous shape (Fig. 5a), the location of the fiducial F is
known
21 relative to the shape S itself and thus the pattern is properly positioned
before
22 cutting.
23 Practically however, and as illustrated in Figs. 6, 7a - 8b, the sheet
24 material 10 itself can be distorted such as due to residual stresses in
woven material
or the moving sheet material 10 can additionally rotate, stretch, or further
distort such
16
CA 02413820 2002-12-10
1 as bow or skew after between the supply of the sheet material and the vision
system
2 12, all of which jeopardize this ideal scenario of pattern and shape overlay
or
3 matching. It is useful to minimize further distortion between the vision
system 12 and
4 the cutting system 11 where there is no secondary system currently applied
to
monitor further distortion. In such cases the geometry of the predetermined
pattern
6 P no longer corresponds with the distorted preset shape S and matching
errors upon
7 cutting can occur unless the predetermined pattern is altered or remapped to
better
8 comply with the actual form of a distorted preset shape.
9 A variety of cases can be broadly categorized as:
= Figs. 5a,5b Stamp: In this scenario, the controller program does not
11 need to alter the geometry of the pattern P at all. The vision
12 system 12 need only locate the preset shape's corresponding
13 fiducial F on the material 10, superimpose the pattern P and apply
14 the pattern's cut lines as an overlay over the preset shape S and
cut out the shape as would a stamp or cookie-cutter;
16 = Figs. 3,6 Rotate: In this scenario, the program needs only to alter
17 the geometry of the pattern P by mere rotation. The vision system
18 needs two fiducials F,F2. A first reference fiducial F anchors the
19 shape to the pattern P and a second fiducial F2 identifies a rotation
of the material 10 and of the shape S from a characteristic point P2
21 of the pattern P and relative to the reference fiducial F.
22 = Figs. 7a,7b, Stretch & Shift: In this scenario, the program needs
23 only to alter the geometry of the pattern P by mere geometric
24 stretching (or compression) in X, Y or both. As shown in Figs.
7a,7b, a longitudinal stretch is identified using two or more fiducials
17
CA 02413820 2002-12-10
1 F,F2 so as to define a reference length of the preset shape, F-F2,
2 whether it be longer or shorter than the corresponding coordinates
3 for the pattern, F-P2, and thus perform a "stretching" the pattern in
4 the appropriate warp or weft direction and, as necessary, to
perform a translation.
6 = Other remapping scenarios can be applied to all or a portion of a
7 shape S based on predetermined algorithms to account for critical
8 areas of the shape which should not be remapped and others
9 which can be remapped.
= Figs. 8a,8b,9, Linear Bow & Skew: In this scenario, one or more
11 areas or patches in the pattern P are defined bounded by at least
12 three fiducials in an X,Y coordinate system. Multiples of three
13 fiducials define triangular patches and multiples of four fiducials
14 define a plurality of rectangular patches. The vision system
determines bow and skew from the ideal pattern P. The program
16 then needs only to re-map the pattern coordinates from the ideal
17 pattern to a remapped pattern P which better reflects the bow and
18 skewed area. Remapping can be applied to all or a portion of a
19 shape S having two or more patches. Such a remapping process
might be a simple linear translation of the coordinates or leaving a
21 portion and modifying another portion. As shown, one embodiment
22 implements one or more rectangular areas or patches bounded by
23 at least four fiducials, two fiducials in X and two fiducials in Y.
24 = Interpolated Bow & Skew: As before in linear bow and skew, and in
this scenario, areas in the pattern P are defined such as a using
18
CA 02413820 2002-12-10
1 rectangular patches bounded by at least two fiducials in X and two
2 fiducials in Y. Once the vision system determines bow and skew,
3 then the coordinates of the pattern P are corrected by interpolating
4 using an Nth degree polynomial to smooth the cutting for all points.
Accordingly generally, in operation, and referring to Block B1 of Fig. 10,
6 the relative geometry between the vision system 12 and the cutting system 11
is
7 determined for placing the sheet material 10, the vision system 12 and the
cutting
8 system 11 in a global coordinates system.
9 The vision system 12 is located at known coordinates X,Y upstream of
the cutting system 11. The conveyor 16 has known speed characteristics. A
11 calibration is performed between the coordinates of a fiducial F at an
origin point and
12 the actual cutter 13 of the cutting system 11. Such a calibration is
typically
13 predetermined as required, such as at the beginning of a roll of sheet
material 10.
14 The origin is identified and the operator advances the material until the
origin is
visually positioned under the cutter. All relative coordinates are thereafter
known in
16 the global coordinate system. Cutting can then commence according to the
pattern
17 and substantially continuously thereafter and concurrently which the
location of
18 fiducials F.
19 The pattern has predetermined coordinates which are typically known
before the process begins at Blocks A1,B1. Using the pattern, one can
calculate at
21 Block A2 the cut line path and bites suitable for the cuffing system. The
motion
22 profile can be calculated at Block A3. The cut lines and motion profile may
or may
23 not need to be changed on-the-fly
24 The conveyor 16 is operated and a process of concurrent location of
fiducials and cutting shapes commences. At Block B2, the vision system 12
looks
19
CA 02413820 2002-12-10
1 substantially continuously at a width of the sheet material 10 passing
thereby for
2 seeking one or more fiducials F, F2 .....An effective width is selected
within which
3 fiducials appear, practically being somewhat less than the entire transverse
width of
4 the sheet material. As is known by those skilled in the art, various rules
can be
applied for determining if a candidate recognized by the vision system 12 at
Block B3
6 qualifies as a fiducial including inherent vision-based detection
thresholds. For
7 minimizing the processing overhead, and minimizing the incidence of false
positives,
8 the vision system can be instructed to only watch a subset of the transverse
width,
9 limiting the effective to one or more regions of interest.
The global coordinates x,y of each fiducial are forwarded to means for
11 comparing the pattern and the fiducials at Block B5. The vision system 12
12 recognizes and determining fiducial coordinates concurrently and thus
regardless of
13 the downstream activity such as the operation of the cutting system 11. For
14 convenience and to distribute the computing burden, the vision system 12
controller
21 processes incoming data such as coordinates x,y independently from the
16 controller 22 processing instructions performed by the cutting system 11.
17 The sheet material 10 is moving and thus the coordinates of the
18 fiducials F,F2 ...are also moving. Using any of a variety of computation
techniques
19 including moving arrays of coordinates or time and space calculations, the
fiducials
F,F2... are tracked in the global coordinate system of the cutting system 11.
21 At Blocks B6,B7,B8, the location of the shape S is determined with a
22 minimum of one fiducial F and can also adapt to correct distortion of the
shape using
23 two or more fiducials F,F2,F3 ... . This adjustment is accomplished on-the-
fly by
24 matching recognized fiducials F with a digital template of the pattern P
and then
CA 02413820 2002-12-10
1 making adjustments as desired to the pattern's geometry for achieving the
desired
2 accuracy of cutting of the preset shape S.
3 In a simplest implementation at Block B8, one fiducial F is found and
4 thus the location of the preset shape is known and, at Block B14, the
corresponding
pattern is applied relative to the location of the fiducial F to cut the
preset shape S. If
6 there is a translation required, the motion profile may be recalculated at
Block 11.
7 In other implementations, the patterns may be characterized by two or
8 more fiducials F,F2. In these embodiments, one applies additional
methodology to
9 accommodate distortions from the pattern's ideal or predetermined geometry
as
described above.
11 At Block B7, the vision system 12 recognizes a first fiducial F for a
12 known pattern and which locates the preset shape S in the sheet material.
The
13 vision system identifies and reports at least one additional fiducial F2
which the
14 controller compares with the pattern P to identifies the nature of any
distortion. If
found, then the pattern P is remapped according to the nature of the
distortion before
16 proceeding to the cutting of the distorted preset shape at Block 14.
17 At Block 14 the preset shapes S are cut based on the one or more
18 previous fiducials. The pattern, as originally defined or remapped, is
superimposed
19 on the sheet material based on the predetermined coordinates of the pattern
applied
at the global coordinates of the fiducial. While the cutting system 11 is
proceeding
21 based on previous fiducials, the vision system 12 is simultaneously or
concurrently
22 locating one or more subsequent fiducials in the moving sheet material;
23 Typically the motion profile at Block 11 is recalculated. Dependent
24 upon the extent of the distortion, the cut lines or path may also need to
be
recalculated for optimally driving the cutting system 11. One case which can
provide
21
CA 02413820 2002-12-10
1 enough distortion information and thereby benefit from recalculated cut
lines is a bow
2 and skew scenario.
3 At Block B9 and generally driven by the complexity of the pattern, the
4 vision system expects to find a plurality of additional fiducials F2,F3 ...
Fn which
define patches. Distortion is discretized and reflected in distortion of each
patch. A
6 distorted shape is remapped by remapping each patch. Then the cut line path
may
7 be recalculated at Block 1310 and the motion profile is recalculated at
Block 11 before
8 proceeding to the cutting of the distorted preset shape at Block 14.
9 Use of patches enables variable remapping within a shape. Triangular
patches are defined by three fiducials per patch and adjacent triangular
patches
11 share two fiducials. Accordingly, two or more patches require 2+1 n
fiducials, where
12 n represents the number of patches. Similarly, rectangular patches require
2+2n
13 fiducials. Other polygonal shaped patches may be used. A variety of
remapping
14 algorithms can be used depending upon the patch geometry and the type of
remapping desired. In a simple case, an ideal patch may be rectangular (xO,yO -
16 x3,y3) and which may become distorted into a four sided polygon (x'O,y'O -
x'3,y'3).
17 Each patch can have the same or a unique mapping function. In such a case,
each
18 point is translated from a rectangular to the non-rectangular patch. In a
linear bow
19 and skew analysis, one mapping function can be x'=Ax+By+Cxy+D and
y'=Ex+Fy+Gxy+H. Four equations can be written for four unknowns and one can
21 solve for A,B,C,D. Similarly, one can solve for E,F,G,H. Making some
assumptions
22 simplifies the solution.
23 As shown in Figs. 9b-9d, fora plurality of rectangular patches, adjacent
24 patches have pairs of fiducials having the same x coordinates and pairs of
fiducials
having the same y coordinates. Further, one may assume an origin fiducial
xO,yO of
22
CA 02413820 2002-12-10
1 the first patch is the same as the distorted patch x'O,y'O. Now, the
equations can be
2 solved directly. For cut-on-the-fly considerations, it is useful to place
bite boundaries
3 on patch boundaries .
4 Referring to Fig. 11, with these basic principles in mind, and in a
practical illustrative embodiment, the cutting system 11 can comprise a
standard
6 laser cutter, model Lacent 1000 from Lacent Technologies Inc., Edmonton,
Alberta
7 Canada, configured and operating substantially as that disclosed in US
Patent
8 6,294,755. Among the variations from the apparatus set forth in US 6,294,755
is that
9 the cutting system is equipped with a Rofin-Sinar 1000 watt, sealed laser.
The
Lacent 1000's cutter positioning system is capable of traveling at velocities
of up to
11 1500 mm/second with accuracy better than '/% mm. The positioner carrying
the laser
12 cutter is controlled with at positioner motion controller (PMC or PMAC).
The
13 conveyor's bed is capable of traveling at velocities up to 130 mm/second.
The
14 conveyor 16 is controlled with a conveyor motion controller (CMC). Finished
sheet
material has a maximum width of 2.4 meters and is typically supplied on rolls
16 weighing up to 1400 Kg.
17 As shown in Figs. 2a,2b and 12, the cutting system 11 is adapted with
18 a camera-based vision system 12 capable of contrast detection of up to six
fiducial
19 marks spaced transversely over an effective material width of 2.6 meters.
The vision
system comprises an array of four cameras 30,30,30,30 each covering a region
of
21 approximately 0.65 by 0.5 meters. Four cameras as a cluster therefore cover
the
22 effective width of 2.6 meters by 0.5 meters long. Special ballasted low
maintenance
23 fluorescent lighting aids the cameras and the vision processing system by
providing
24 flicker-free lighting.
23
CA 02413820 2002-12-10
1 The system 13 determines the location of each fiducial F with an
2 accuracy of better than 2 mm as the sheet material 10 moves continuously,
but not
3 necessarily uniformly beneath it into the cutting system's cutting zone.
Using
4 cameras 30, such as those by Sony having 600X800 pixel resolution and non-
interlaced 60Hz capture rates, and at conveyor speeds of 5 inches per second
6 (130mm/s), the motion blur is better than 1/12 of an inch (2mm). As set
forth in the
7 illustrative embodiment, it has been found that preset shapes up to 2.6
meters in
8 width moving at 130 mm/second can be accurately tracked within a 10mm seam
9 allowance of the pattern.
Six sets of transversely spaced fiducials F may be processed every %
11 meter moved with material moving up to 130 mm/second. This accommodates
more
12 than one fiducial per preset shape allowing the system to compensate for
"bow &
13 skew" scenarios. Limited only by the physical size of the example Lacent
1000
14 cutting system only, the patterns may be up to 3 meters in length. Sheet
materials
successfully cut using the present system include silicon coated nylon with a
fabric
16 weight of 700g/m2 (20.7 oz).
17 The vision system is capable of detecting, distinguishing or recognizing
18 and locating the coordinates of one or more fiducials in the material. As
shown a set
19 of 6 transverse fiducials can be located and subsequent sets can be
detected as the
sheet material 10 passes under the visions system 12. The vision system 12
21 processes incoming data independently from the Lacent 1000 laser cutting
system.
22 The vision system detects cross hair fiducials F placed on or in the sheet
material.
23 The discrete coordinates of a fiducial on the sheet material 10 are known
in the
24 coordinate system of the cutting system 11. As the material traverses the
vision
system, material position indications are received from time to time and
matched to
24
CA 02413820 2002-12-10
1 the fiducials are recognized. More so for the convenience of a human
operator, a
2 system encoder is interfaced to a Pentium-based computer for providing
position
3 indications which appears in a monitoring widow of the vision system. A 48
bit
4 encoder can provide opto-isolated differential 0-5V quadrature signals at
4000 pulses
per inch, which at 5"/s is 20,000 pulses per second. The fiducial coordinates
are
6 also passed as a digital string via an RS-422 serial communications
interface to the
7 cutting program. A timing strobe is provided to provide synchronization
accurate to a
8 millisecond indicating the moment in time at which the positions and
coordinates
9 were valid.
The lighting and cameras 30 are mounted upstream and adjacent to
11 the cutting zone of the cutting system 11. The images from the camera
clusters
12 30,30,30,30 are processed by an image processing system. The image
processing
13 system interfaces to an operation via an interface such as a Pentium-based
(Intel
14 Corporation) computer. The vision system software is capable of real time
operation
with material motion at continuous and at continuously variable rates of up to
130
16 mm per second.
17 With reference to Fig. 13, the, the vision system's cameras are immobile
18 and look or stare at the effective width of the sheet material as it passes
by. The
19 vision system is controlled by a vision executive or program which receives
fiducial
information from the vision system via an RS-422 link and then manages the one
or
21 more fiducials in a queue. Each fiducial is analyzed by matching the
fiducial
22 information against a digital template of the pattern. Through information
exchange
23 and cooperation, the vision system and cutting system, as necessary, remap
the
24 pattern geometry and calculate new cut lines for instructing the positioner
PMC and
CA 02413820 2002-12-10
1 the conveyor CMC on-the-fly., and then. Multiple fiducials enable detection
of
2 distortion in the sheet material.
3 As set forth in Fig. 14, the vision system 12 comprises cameras 30 and
4 lighting 31 coupled through an interface to the vision executive or
controller 21. The
vision system 12 also communicates with the cuffing system 11 in several
aspects:
6 one to receive and maintain a relationship between the cutting system's
encoder and
7 possibly to receive correction or reset information therefrom; and to
communicate
8 with the cutting system controller 22 for providing fiducial coordinate
information.
9 The cutting system maintains control of the real-time movement of the
material and
the preset shape in the global coordinate system through the encoders and
motion
11 controllers.
12 The vision system 12 can be tuned knowing basic characteristics of the
13 sheet material so as to adapt to different fiducials and distinguishing the
fiducial from
14 visual background noise.
The known pattern P of the preset shapes S are stored in the memory
16 of a computer system operating appropriate programs for performing real-
time
17 optimization of cut lines, and for performing translation and rotation of
the pattern's
18 coordinates. The pattern is typically stored as a vector file referenced to
an origin, an
19 example of such being an AutoCAD drawing file or Drawing eXchange Format
(DXF)
file. The vision system captures and analyzes images being taken by at least
one
21 camera. The cameras are connected to a computer system which performs the
22 detecting analysis. The co-ordinates of the cameras 30 are in a frame of
reference
23 relative to the coordinates of the laser cutting system 11. Accordingly, a
located
24 fiducial F is known in a coordinate system of the cutter 13 of the cutting
system 11.
26
CA 02413820 2002-12-10
1 Accordingly, while the cutting system 11 is cutting a previously located
2 preset shape in the continuous stream of sheet material 10, the vision
system 12 is
3 simultaneously determining the reference coordinates of the next shape S.
Each
4 time a shape passes under the vision system, the cutting system is updated
as to the
global coordinates of the approaching shape.
6 This embodiment is typically calibrated before first operation as follows:
7 The operator first advances the sheet material to the vision system 12 and
verifies
8 the location of the very first fiducial or origin mark recognized thereby.
Error handling
9 for missed or unexpected fiducials and an operator interaction may be
required at in
the first instance. The operator acknowledges the identified coordinates of
the
11 fiducial as a calibration origin. The conveyor and sheet material are
advanced to the
12 cutting system 11 so as to align the origin with the cutter 13.
13 The system identifies a "pattern" and related fiducial information which
14 are conveniently stored in a computer-aided drawing CAD file, such as would
be
output from a CAD program AutoCAD, available from Autodesk Inc., Cupertino, CA
16 in an AutoCad DXF format. A program "Lind' is used to process the known
pattern
17 geometry and further: imports pattern and fiducial information from the DXF
file;
18 exports pattern fiducial locations; exports pattern information associated
for all cut
19 line vectors; accepts a material type for each pattern; and inserts offset
correcting
code into the PMAC and CMC.
21 A supervisory motion controller runs in either the prior art mode so as to
22 apply pattern cutting regardless of material or in vision mode which
applies the
23 apparatus and methodology of the present invention which is aware of preset
shapes
24 in material. In vision mode, the motion controller manages many aspects of
the
operation including: tracking vision system offsets; instructs the vision
system what
27
CA 02413820 2002-12-10
1 material type profile to use; accepts unsolicited fiducials from the vision
system;
2 continuously match fiducials to the pattern's digital template; remaps or
adjusts for
3 each pattern and downloads the remapped patterns to PMAC; calculates
adjusted
4 marker length for download to PMAC; allowing operators to indicate marker
origin on
the very first instance or on error to produce a fiducial map; and permitting
various
6 operator feedback capability.
7 As stated above and as set forth in greater detail in US 6,294,755 to
8 Sawatzky et al., increased throughput is achieved through optimization of
the
9 movement of a tool which can involve high velocity and accelerations and,
accordingly, the X-Y positioner for the tool must be capable of high
acceleration and
11 precise movements.
12 The parts of a pattern P have generally already been pre-fitted into the
13 nest (Fig. 3). The nest is a plurality of shapes laid out in a collection
or grouping so
14 as to minimize material waste. A bite length or width is determined which
is machine
dependent and is generally less than the length of a nest. It is necessary to
calculate
16 a bite because the longitudinal length of a pattern P or nest may not fit
within the cut
17 zone the cutting system 11. A bite is approximately 1/2 the length of the
longitudinal
18 length of the cut zone of the system 11. For example a 44 in. cut zone may
only
19 provide a 22 in. bite.
A digital motion controller and computer process the cutting system's
21 X1, X2 and Y positioner encoders and conveyor movement information. The
22 computer processes the pattern information and outputs optimized cut moves
to the
23 PMC and the CMC. The motion controller outputs commands to drive the linear
24 motors for the positioner and drive for the conveyor to coordinate the
motion of laser
nozzle 13 on the X-Y positioner and the speed of the conveyor. A process takes
the
28
CA 02413820 2002-12-10
1 pattern geometry and optimizes the movement of the laser nozzle over the
sheet
2 material10.
3 In overview, and referring to the flow chart of Fig. 15, after the geometry
4 of a pattern P, or remapped pattern, is received:
(a) at block 118, the geometry is organized into machine dependent
6 bites which fit within the cutting zone 11;
7 (b) at block 120, the cutting sequence across width of the bite is
8 optimized. As a result, geometry is established as a series of continuous
cuts
9 separated by dry hauls;
(c) at block 123, the geometry of the continuous cuts is optimized into a
11 plurality of discrete moves by minimizing the number of non-tangent
intersections
12 forming new moves, and thus minimizing inefficient stop and go actions
within the
13 continuous cut;
14 (d) at block 126, the positioner motion profile is determined by
optimizing the velocity profile of each discrete move, all the while being
cognizant of
16 system constraints. Curved moves are also referred to generically as moves
or as
17 curves; and finally
18 (e) at block 127, the conveyor motion is optimized for maintaining
19 piecewise continuous, forward velocity, even between bites and velocity is
not
permitted to become negative.
21 The resulting geometry is stored and the optimized moves are sent
22 through the motion controllers CMC, PMC for driving the conveyor 16 and
positioner
23 for cutting the pattern P superimposed over the preset shape S in these
24 embodiments.
29
CA 02413820 2002-12-10
1 With respect to optimization, by looking ahead to the next move, one
2 can optimize the movement of the laser nozzle. The objective of this "Look
ahead"
3 process is to minimize the time that is required to follow any arbitrary
geometry or
4 pattern P while avoiding exceeding specified maximum acceleration's and
velocities
or drifting outside dimensional tolerances.
