Numerical algorithms for curve approximation and novel user oriented interactive tools

Transcription

1 UNIVERSITÀ DEGLI STUDI DI BARI Dottorato di Ricerca in Matematica XXI Ciclo A.A. 2008/2009 Settore Scientifico-Disciplinare: MAT/08 Analisi Numerica Tesi di Dottorato Numerical algorithms for curve approximation and novel user oriented interactive tools Candidato: Loredana Chieppa Supervisori della tesi: Prof. Giovanni Di Lena Prof. Michele Fiorentino Prof. Antonio E. Uva Coordinatore del Dottorato di Ricerca: Prof. Luciano Lopez

2

3 iii To my parents Ai miei genitori

4

5 Contents Acknowledgements Introduction xi xiii 1 Background and literature review Curve representation Bézier curves B-spline curve Wavelets analysis History Mathematical definition Wavelet for Computer Graphics Wavelet as new language Multiresolution analysis Multiresolution curve Part one: B-spline Curve Approximation with Optimal Knots Introduction Preliminaries Extension to the not convex functions Optimal knots for plane curves Optimal knots for cubic B-spline Application to knot removal tool Numerical examples Convex functions approximation Not Convex functions approximation Plane curves approximation Knot removal application

6 vi 4 Part two: 2D sketching using multiresolution approach Introduction Sketch curve style Related work The proposed approach Multiresolution Engine Multi-level Segmentation Smoothing with continuity constraints Implementation and examples 85 Conclusion and future work 89 Bibliography 93 Index 97

7 List of Figures 1.1 Bézier curves of various degree (left) The example of uniform B-spline curve. (right) The basis functions of uniform cubic B-spline A mother wavelet and two daughters The filter bank Convex function Convex function: catenary Not convex function Not convex function Curve plane: spiral function Convex function rotation Not convex function rotation Curve plane rotation Knot removal method: example Knot removal method: example Knot removal method: example Knot removal method: example Style sketches for a car bodies Sketches and character lines of cars model Sketches of car model Graphic tablet device for digital design Original curve with 11 control points Original curve and its coarse version with 7 control points Original curve and its coarse version with 4 control points The original curve C(t) The original curve (11 control points) and its coarse version (4 control points)

8 viii 4.10 The segmentation points Normalized graph of distances and threshold at Segmentation point refinement from seven (top) to four (bottom) User interface for intuitive sketching Synthetic curve segmentation: test A Synthetic curve segmentation: test B Synthetic curve segmentation: test C Synthetic curve segmentation: test D Car body sketch with a graphic tablet Segmentation of the car outline Original car sketch profile (sedan) Seven features points detected on the sketched profile New sketch car profile generated by a CAD designer Feature points detected by system after segmentation Curve extracted by profile of the car in Figure 5.5 after segmentation Example of local simplification of a sketch section: original and smoothed Example of local simplification of a sketch section: original and smoothed with C 1 constraint

9 List of Tables 3.1 Uniform knots Not uniform knots Not convex function Resnorm values Test functions errors Standard and optimal errors

10

11 Acknowledgements Foremost, I would like to extend my deepest gratitude to my supervisor Professor Giovanni Di Lena of University of Study - Bari, for giving me the opportunity to undertake research work in the field of applied mathematics to Computer Graphic. I thank him for providing me with the opportunity to complete my PhD thesis at University of Bari, and for giving me the mathematics basis to work in this not easy research field. I am also grateful to Prof. Nicoletta Del Buono for supporting me during my PhD period at University of Bari and for her assistance during writing out of my thesis. I especially want to thank Professor Giuseppe Monno and my advisors Prof. Michele Fiorentino and Prof. Antonio E. Uva of Department of Mechanical Engineering, Polytechnic of Bari, whose support and guidance made my thesis work possible. They have been actively interested in my work and have always been available to advise me. I am very grateful for their patience, motivation, enthusiasm, and immense knowledge in the Computer graphics applications. I am also grateful to my friend, industrial designer, Tony Azzella, for introducing me to the wonderful world of applied mathematics to computer graphics. Special thanks, also, to my family and to my boyfriend Francesco for their understanding, patience and support during the entire period of my study.

12 xii

13 Introduction The present work is concerned with two particular aspects in the large field of numerical approximation in the area of Computer Graphics (CG). In particular we study the approximation of plane curves with optimal knots and the develop of sketch style curves using multiresolution approach. These two aspects, apparently independent of each other, can be regarded as tools of a single system opportunely designed to tackle problems in field of interactive sketch style curves. In the Computer Graphics area the approximation of curves or surfaces is an important field on which concentrate mathematical studies. The continuous challenge is to find more and more approximation techniques that are competitive both in term of mathematic flexibility and algorithmic performance. Exactly from this point of view, in the previous decades a series of techniques have been developed in order to obtain tools characterized by an increasing computational power and reduced costs. This thesis takes its place in the active research area of Computer Graphics and have two main aims: firstly the mathematical investigation of the problem of the optimal knots curve approximation and secondly the development of proper mechanism to sketch style curves. In order to obtain these aims we divided this work in two main parts. In the first part the plane curves approximation problem is tacked using the concept of optimal knots sequence as suggested in the work of Hamideh in [14]. We started searching first optimal knots sequence for not convex function until arriving to determine a method to approximate curves plane with optimal knots. Furthermore this optimal representation can be useful as a better alternative in some applications as, for example, the knot elimination. The second part of the thesis, instead, is mainly devoted on the study of the sketch style curves. At the present time, the market value of products depends more and more on aesthetic and ergonomic aspects. In spite of this, desktop CAD software does not assist well in the definition and adjustment of free

14 xiv Introduction form curves to improve beauty and the success of products. This explains the extensive use in industry of manual sketches on paper. For these reasons we have developed and evaluated innovative methods and algorithms for the interactive generation of quality 2D freeform curves with graphics tablet input. The proposed system uses multiresolution analysis based on wavelets, as a mathematical support technique in the sketching procedure. This multiresolution approach is the basis of this second part: by using and improving its potentiality with new techniques discussed and implemented in this thesis, we introduce a 2D sketching framework using a novel user oriented algorithm to segment, edit and smooth free-form curves. In the following sections we give firstly an overview on the background and literature review regarding the topics of this thesis and then we analyze and go into details first on the B-spline curve approximation with optimal knots and then on 2D sketching using multiresolution approach. Furthermore, we show some examples and implementation of both procedures.

15 Chapter 1 Background and literature review The goal of Computer Graphics is to produce pictures or images by computer with the help of mathematical computation. It is a rapidly expanding field of computer science, with application in a variety of areas including film and television post production, computer entertainment, engineering and medical data visualization, image processing and virtual reality, architecture and computer aided design. From the earliest text character images of a non-graphic mainframe computers to the latest photographic quality images of a high resolution personal computers, from vector displays to raster displays, from 2D input to 3D input and beyond, computer graphics has gone through its short, rapid changing history. Moreover the power and flexibility of graphics hardware and software is constantly improving, making this an exciting and dynamic area to work in. Computer technology is, also, widely used in daily activities, such as filmmaking, publishing, banking, engineering, and education. Engineers and architects use computers to design images or products and computer-aided design (CAD) and computer-aided manufacture (CAM) are two important areas where computer graphics plays a central role. Both (CAD) and (CAM) are widely used in aerospace, automotive engineering, marine engineering, civil engineering, and electronic engineering, just to mention some areas in which they are important. The application of computer graphics in engineering constitutes the foundation of computer aided geometric design (CAGD), which provides the mathematical basis to describe and process geometric shapes and data.

16 2 Chapter 1. Literature review As we have seen CG is at the center of many important research fields, so it is important to find new methods and applications. In this chapter we give a brief overview on the mathematical functions, used in this thesis, that are at the base of many CG applications. In particular, we present some common methods of spline approximation as Bézier and B- spline curves and then we introduce wavelet approach for Computer Graphics and multiresolution analysis which is intimately connected with the study of wavelets. These curves representation and wavelet approach will be used and showed in the numerical applications presented in this thesis. 1.1 Curve representation Since the birth of Computer Graphics, it has been graphics developers greatest aspiration to develop something that is as close to reality as possible. A special attention in CG has been directed in the search of better curve representation. The need to represents curves and surfaces arose by need to modeling existing objects (a car, a face, a mountain) and in modeling from scratch, where no preexisting physical object is being represented. The two most common methods of representing curves in geometric modeling are implicit equations and parametric functions. The implicit equation of a curve lying in the xy plane has the form f(x, y) = 0. This equation describes an implicit relationship between the x and y coordinates of the points lying on the curve. An example of implicit equation is given by the circle of unit radius centered at the origin, described by the following equation f(x, y) = x 2 + y 2 1 = 0. (1.1.1) The parametric functions, instead, are defined using parameters. In this case each of the coordinates of a point on the curve is represented separately as an explicit function of an independent parameter, that is, C(t) = (x(t), y(t)), t [0, 1]. (1.1.2)

17 3 For example, one set of parametric equations for the unit circle are: { x(t) = cos(t), y(t) = sin(t). (1.1.3) It is important to mention that the parametric representation of a curve is not unique. It is difficult to decide which of the two given representations of the same curve is the best to describe it; they could present both advantages and disadvantages. From a detailed analysis showed that the parametric form is more natural for designing and representing shape in a computer. However, as the coordinates parametric functions are arbitrary, is obvious to ask what is the best representation to choose. The ideal situation, that compensates implementation problems with an efficient representation of the curves, consists in the choose functions that: are capable of precisely representing all the curves the users of the system need; are easily, efficiently and accurately processed in a computer; are simple and mathematically well understood; A widely used class of functions that satisfy the last two criteria is the polynomials. Two common mechanism to express polynomial functions are: power basis, Bézier curves. These two methods are mathematically equivalent, but the Bézier method is far better suited to representing and manipulating shape in a computer. Let see in more details the Bézier representation. Bézier curves This spline approximation method was developed, in the late 1960s, by the French engineer Pierre Bézier for use in the design of automobile bodies while

18 4 Chapter 1. Literature review working for the car manufacturer Renault. Bézier curves have a number of properties that make them highly useful and convenient for curve and surface design. Furthermore they are also easy to implement, so, for these reasons Bézier curves are widely available in various CAD systems and in assorted drawing and painting packages. As we have said previously a Bézier curve is a parametric polynomial curve. We can define an nth-degree Bézier curve as: so that C(t) : [0, 1] R 2, (1.1.4) C(t) = n B k n (t)p k; (1.1.5) k=0 where P 0, P 1,...,P n 1, P n are called control points and the basis functions (also called blending functions) B k n (t) are the classical nth-degree Bernstein polynomials given by: B n k (t) = n! k!(n k)! tk (1 t) n k. (1.1.6) In any curve representation scheme, the choice of basis functions determines the geometric characteristics of the scheme. The Bernstein polynomial functions have the following properties: Positivity: B n k (t) 0 k = 0,...,n; B n 0 (0) = B n n(1) = 1; B k n(0) = B k n (1) = 0, k = 1,...,n 1; B k n (t) attains exactly one maximum on the interval [0, 1]. In particular it can be proven that the maximum occurs at the point t = k n. Partition of unity: n n ( ) n B k n (t) = (1 t) n k t k = (1 t + t) n = 1. k k=0 k

19 5 Symmetry: for any n, the set polynomials { B k n (t)} is symmetric with respect to t = 1 2. Derivatives: d dt B k n d dt B 0 n (0) = n; d dt B 1 n (0) = n; d (t) = n( B n 1 k 1 dt B n(1) n = n; d dt B n 1(1) n = n; n 1 (t) B (t)); d dt B k n (k ) = 0; 0 < k < n (1.1.7) n recursive definition: by using the following formula ( ) ( )( ) n n 1 n 1 =, k k k 1 the Bernstein polynomials can be generated by the recursive formula: B n k n 1 (t) = (1 t) B k (t) + t k n 1 B k 1 (t). (1.1.8) We have enumerated the principal properties of the basis functions, now we are going to describe properties that are satisfied by the Bézier curves: Endpoint interpolation: A very useful property of a Bézier curve of nthdegree is that it always passes through the first and last control points. That is, the boundary conditions at two ends of the curve are: C(0) = P 0 ; C(1) = P n ;

20 6 Chapter 1. Literature review Furthermore, the values of the parametric first derivatives of a Bézier curve at the endpoints can be calculated from control point coordinates as: C (0) = n(p 1 P 0 ); C (1) = n(p n 1 P n ); Thus, the slope at the beginning of the curve is along the line joining the first two control points and the slope at the end of the curve is along the line joining the last two endpoints. Convex hull: The curve is contained in the convex polygon generated by the convex closure of its control points. This property is known as convex hull property and follows from the blending functions properties: positivity and partition of unity. Affine invariance: Bézier curves are invariant under affine parameter transformations. That is, while the curve is usually defined on the parametric interval [0,1], a simple affine transformation on the parameters to the interval [a,b] yields the same curve. Closed curve: If P 0 = P n the curve is closed and presents, in general, a singular point (cusp) in the connection point. If the three points P 1, P 0 = P n, P n 1 are aligned the curve is smooth (that is, the tangent vectors at t = 0 and t = 1 have the same direction). We observe that for: - n = 1, we have B 0 1(t) = 1 t and B 1 1 (t) = t, so the Bézier curve of first-degree has the following expression: C(t) = (1 t)p 0 + tp 1. (1.1.9) This is a straight line segment connecting the control points from P 0 and P 1 ; - n = 2, we have: C(t) = (1 t) 2 P 0 + 2t(1 t)p 1 + t 2 P 2, (1.1.10) This is a parabolic arc connecting the control points from from P 0 to P 2 ;

21 7 - n = 3, we have: C(t) = (1 t) 3 P 0 + 3t(1 t) 2 P 1 + 3t 2 (1 t)p 2 + t 3 P 3. (1.1.11) This is a cubic Bézier curve. Figure 1.1 shows sample curves of degree one through four. A degree n Bezier curve has n + 1 control points. Figure 1.1: Bézier curves of various degree We will use linear and quadratic Bézier curve representation in the section 4.7, as skeleton curve to construct coarse versions of a curve during the smoothing phase, that satisfy continuity constraints at its endpoints. In the next section we recall the definition and some important properties of another curve representation called B-spline curve. B-spline curve B-splines is a different approach to representing piecewise polynomial curves and they are the most widely used class of approximating splines. Now we see how B-spline representation has better geometric properties respect to Bézier curves. As already observed the Bézier curves consist of just one polynomial segment. There are several reasons which can be addressed to demonstrated the inadequacy of Bézier representation in several circumstances: when a large number of constraints must be satisfied a Bézier curve with

22 8 Chapter 1. Literature review a high degree, is required. However these curves are inefficient to be computed and are numerically unstable; the Bézier curves are not well-suited to interactive shape design; the Bézier curves do not possess a sufficiently local control. To overcome these drawbacks we have to consider the B-spline curves. Before to construct B-spline curve and see how they are defined, we have to introduce a new entity, knot vector, and firstly define the B-spline basis (or blending) functions. Let us consider an increasing sequence of m + 1 real numbers: U = {u 0 u 1... u m 1 u m }; where u i are called the knots and U the knot vector, then the B-spline function of p-th degree (or order p+1), with k = 0,...,m (p+1) can be defined as: B p k : [u 0, u m ] R; (1.1.12) and it possesses the following properties, for all t [u 0, u m ]: Positivity: B p k (t) 0, k = 0...,m (p + 1); Partition of unity: m (p+1) B p k k=0 (t) = 1; Linear independence: m (p+1) B p k k=0 (t) are linearly independent; Local support: supp(b p k ) = [u k, u k+(p+1) ], that is its support consists of p+2 consecutive knots. These properties of the B-spline basis functions are very important because their determine the many desirable geometric characteristics in B-spline curve. The shapes of the Bk n basis functions are entirely determined by the relative spacing between the knots (u 0, u 1,...,u m ). Scaling or translating the knot vector has no effect on shapes of the basis functions and the B-spline. There are several ways to define B-spline basis functions, e.g. by divided differences of truncated power functions, by blossoming and by a recurrence

23 9 formula. The last one way is the most useful for computer implementation. The k-th B-spline basis function of p-degree (order p + 1) can be defined by the Cox-deBoor recursion formula as: B 0 k (t) = { 1, uk t < u k+1, 0, otherwise. B p k (t) = t u k B p 1 u k+p u k (t) + u k+p+1 t B p 1 k u k+p+1 u k+1 (t), (1.1.13) k+1 for k = 0,...,m 1. The recursive definition (1.1.13) outlines that the B-spline functions (the space that they generate), belong to a space of piecewise polynomial functions with polynomial of degree p. Furthermore in the recursive formulation (1.1.13) it has been adopted the convention that the indeterminate form 0 0 is equal to zero. The indeterminate form is held to zero to prevent the inconsistent form that arises, for example, when u k = u k+p. With this convention the recursive formula is well suited. Although the B- spline functions are formally defined on the real axes, the B-spline of degree p are considered only on the interval [u p, u m p ]. It is also important give a formula to calculate the derivatives of B-spline basis functions. So, the ith derivative of B p k (t) is given by the general formula: ( (B p (B p 1 k )(i) k ) (i 1) ) = p (Bp 1 k+1 )(i 1) u k+p u k u k+p+1 u k+1 (1.1.14) If some consecutive knots coincide, the number of equal points is called knot multiplicity. This nomenclature can be extended also in the case of a knot subsequence: u k u k+1... u k+p u k+p+1 in which case we will refer to as knot multiplicity with respect to the subsequence. The knots individuate points on the real line; these points are the knots projections on the real line, so, to distinguish these one from the knots they will be called, sometimes, breakpoints. Generally the knot vectors can be uniform, open uniform and non-uniform

24 10 Chapter 1. Literature review distributed. Uniform knot vectors are those vectors for which the distance between two subsequent points, i.e., u i+1 u i is constant, e.g. [0, 1, 2, 3, 4, 5]. In this case the B-splines are called uniform according to to the knot-vector class. Uniform B-splines have periodic basis functions. That is, all basis functions have the same shape, each successive basis function is simply a shifted version of the previous function. Open Uniform knot vectors are uniform knot vectors which have n-equal knot values at each end: u i = u 1, i < n u i+1 u i = const, p i < k + 1 u i = u k+n, i k + 1 e.g. [0, 0, 0, 1, 2, 3, 4, 4, 4], (n=3, k=5). The B-spline curves characterized by this knot-vector, called open uniform B-splines have characteristic that are very similar to Bézier splines. In fact when the p-degree of the polynomial is n, open uniform B-splines reduce to Bézier splines. Furthermore, the polynomial curve for an open B-spline passes through the first and last control points. Finally, non-uniform knot vectors are defined by the only constraint: e.g. [0, 1, 2, 3, 3, 4]. u i u i+1, With unequally spaced intervals in the knot vector, we obtain different shapes for the basis functions in different intervals. Nonuniform B-splines provide increased flexibility in controlling a curve shape. If the knot vector does not have any particular structure, the generated curve will not touch the first and last legs of the control polyline. According to the behavior of a Bézier curve at its end points, we could like to ensure that the curve has tangents to the first and the last legs at the first and last control points, respectively. In order to do so, the first knot and the last knot must be of multiplicity p + 1. This will generate the so-called clamped B-spline curves. By repeating some knots and control points, the generated curve can be a closed one. In this case, the starting and the ending point of the generated curve join together forming a closed loop.

25 11 The B-spline functions of p-degree are polynomial of degree not higher than p in each interval individuated by two consecutive breakpoints, and so they are formally defined on the open set formed by these intervals. Using the derivation rules and a recursive formula, we can prove the following result: d dt Bp Bp 1 k (t) B p 1 k+1 k (t) = p p (t). (1.1.15) u k+p u k u k+p+1 u k+1 In the formula (1.1.15) has been used the convention that the indeterminate form 0 0 is considered equal to zero. Now we can construct a B-spline curves: a pth-degree B-spline curve is defined by C(t) = n B p k (t)p k (1.1.16) k=0 with t [0, 1], where P k are the control points, B p k (t) are the pth-degree B-spline basis functions defined on the nonperiodic knot vector: U = {u 0,...,u p, u p+1,...,u m p 1, u m p,...,u m } with m + 1 knots so defined 0 = u 0 =... = u p < u p+1 <... < u m p 1 < u m p =... = u m = 1 This curve representation is largely used in many CG applications because it has many desirable properties that make it a valid and important toll. Now we see some important properties of B-spline curve as defined in : C(t) is a pth-degree piecewise polynomial curve with n+1 control points and m + 1 knots where m = n + p + 1; Endpoint interpolation: C(0) = P 0 (1.1.17) C(1) = P n. (1.1.18)

26 12 Chapter 1. Literature review The first derivatives at the endpoints of a B-spline curve are given by: C (1) = C (0) = p u p+1 u p (P 1 P 0 ), (1.1.19) p u m p u m p 1 (P n P n 1 ). (1.1.20) Affine invariance: an affine transformation (translation, rotation, scale and shear) is applied to the curve by applying it to the control points. Strong convex hull property: a B-spline curve is contained in the convex hull of its control polyline. More specifically, if t is in knot span [u i, u i+1 [, then C(t) is in the convex hull of control points P i p, P i p+1,...,p i. Local modification: changing the position of control point P i only affects the curve C(t) on interval [u i, u i+p+1 [. Variation diminishing property: if the curve is in a plane this means no straight line intersects a B-spline curve more times than it intersects the curve s control polyline. In this thesis, we use the B-spline curve, in particular the cubic B-spline curve, both in the first part and in the second part. In the second part, in particular, we use uniform B-spline to perform multiresolution curve analysis. In the following figure we show an example of cubic B-spline and its basis functions. Figure 1.2: (left) The example of uniform B-spline curve. (right) The basis functions of uniform cubic B-spline.

27 Wavelets analysis History Wavelets are functions that satisfy certain mathematical requirements and are used in representing data or other functions. This idea is not new. Approximation using superposition of functions has existed since the early 1800 s, when Joseph Fourier discovered that he could superpose sines and cosines to represent other functions. However, in wavelet analysis, the scale that we use to look at data plays a special role. Wavelet algorithms process data at different scales or resolutions. If we look at a signal with a large window, we would notice gross features. Similarly, if we look at a signal with a small window, we would notice small features. The result in wavelet analysis is to see both small and large window. The Wavelets were proposed in the 1980 s as an alternative to the Fourier transforms for signal analysis, and were initially used for representing seismic signal. In fact, the term wavelet was coined by Ricker in 1940 ([28]) to describe the disturbance that proceeds outward from a sharp seismic impulse or explosive charge. However, only in the middle of 1980 s their mathematic theory was formalized in a rigorous manner. The Wavelets are now used as a mathematical tool for hierarchically decomposing functions. They allow any function to be decomposed in terms of a coarse overall shape, plus details that range from broad to narrow. Mathematical definition Definition A wavelet is a function ψ(t) L 2 (R) such that the family of functions ψ j,k (t) =: 2 j/2 ψ(2 j t k) where j and k are arbitrary integers, is an orthonormal basis in the Hilbert space L 2 (R). An orthonormal, compactly supported wavelet basis of L 2 (R) is formed by the dilation and translation of a single function ψ that satisfies the following two-scale difference equation ψ(t) = i p i ψ(2t i) (1.2.1)

28 14 Chapter 1. Literature review where p i is a set of coefficients. The wavelet function has a companion, the scaling function, which also forms a set of orthonormal bases of L 2 (R) φ j,k (t) =: 2 j/2 φ(2 j t k) The scaling function φ also satisfies the two-scale difference equation ψ(t) = i q i ψ(2t i) (1.2.2) where q i is a set of coefficients. Good wavelet are usually constructed starting from a multiresolution analysis. Let us give a definition of this concept. Definition A multiresolution analysis is a sequence {V j } j Z of subspaces of L 2 (R) such that i)... V 1 V 0 V 1... ii) span j Z V j = L 2 (R) iii) f(x) V j if and only if f(2 j x) V 0,i.e. the spaces V j are scaled versions of the central space V 0 iv) f V 0 if and only if f(x m) V 0 for all m Z,that is, V 0 (and hence all the V j ) is invariant under translation. v) there exists a function φ V 0, called scaling function, such that the system {φ(t m)} m Z is an orthonormal basis in V 0 Wavelet for Computer Graphics Several researches in CG have been centered around the use of wavelets. The ideas of multiple levels of resolution, or so called level of detail modeling, have been largely used in CG as in many other disciplines. Thus, when wavelets moved from a mathematical analysis tool to a practical computational tool, they were quickly put to use in CG. The Wavelets can be applied to a wide variety of objects used in graphics, as we point out in the following list:

29 15 Image Processing: some of most powerful compression techniques are based on wavelet transforms; Global Illumination: radiosity and radiance algorithms, that are based on wavelets are asymptotically faster than other finite element methods; Hierarchical Modeling: the use of multiresolution representations for curves and surfaces accelerates and simplifies many applications of editing; Animation: the large constrained optimization tasks which arise in physically based modeling and animation subject to goal constraints can be resolved faster and more robustly with wavelets; Volume Rendering and Processing: the wavelets can simplify the treatment of very large data sets because they can be used as well as feature detection and enhancement; Multiresolution Painting: the use of multiresolution analysis one can build efficient infinite resolution paint systems; Image Query: the use of a small number of the largest wavelet coefficients of an image, gives the opportunity of accelerating searching and retrieval systems. There are several reasons for the enthusiastic welcome wavelet based algorithms have received in CG. Foremost stand the huge computational demands of CG applications. Geometric models, for example, are often built from a large number of primitive elements in order to achieve some desired level of fidelity with respect to a real world object. At the same time, users would desire that all the manipulations and the computations which involve these objects occur interactively, that is, with the screen updates occurring multiple times per second. Similarly, the shading and the motion of these objects should appear realistic. Depending on the number and the complexity of objects appearing in a scene, this can lead to very expensive algorithms. Some examples include the modeling of constrained dynamical systems, the deformation of objects under forces, and the indirect illumination effects. Performing the necessary computations under the constraints of interactivity demands the as efficient algorithms as possible, and the application of some shrewd approximations which permit to preserve a perceived realism. Due to the ability of wavelets to represent compactly functions and data sets within user specified error bounds they are a natural tool to be considered. Their zooming

30 16 Chapter 1. Literature review in ability allows the use of just enough precision in a given region of interest, allowing at the same time coarse representations in regions outside the immediate area of interest. Even more importantly, they facilitate a smooth tradeoff between computation time and resulting simulation quality. Often the algorithms which manipulate these hierarchical objects become asymptotically faster as well, allowing the use of much larger and more complicated scenes with respect to what is possible to treat without this tool. Wavelet as new language The Wavelet take some advantages on the traditional methods like the Fourier analysis especially when the real signal presents some discontinuities. There has been a large interest in studying those functions which approximate discontinuous signals more appropriate with respect to the sin and the cosine functions adopted in the Fourier transform. In fact the deficiencies of Fourier techniques have led researchers in a variety of disciplines to develop various hierarchical representations of functions. This enormous interest, on wavelet theory, in many and different research fields has lead researches to comunicate necessarily between themselves. The mathematician Ingrid Daubechies describes in clear manner what the Wavelets are and how this term became a new communication language among all scientists ([37])....Mathematicians are like the French, the German poet Goethe once remarked. They take whatever you tell them and translate it into their own language - and from then on it is something entirely different. Goethe s observation is as true now as ever. But times may be changing. In the last ten years, mathematicians and researchers in diverse areas of science, engineering and even art have discovered and begun to develop a theoretical language they can all understand. This new common language is sparking new collaborations. Many mathematicians are now crossing over into such applied areas as signal processing, medical imaging, and speech synthesis. At the same time, much deep but abstract - sounding mathematics is becoming accessible to researchers in fields from geophysics to electrical engineering. The new language is wavelet theory. Those who speak it it describe

31 17 wavelets as powerful new tools for analyzing data. Wavelet theory serves as a kind of numerical zoom lens, able to focus tightly on interesting patches of data - but without losing sight of mathematical forest while attending to the trees, twigs, buds, and grains of pollen... Mathematically, wavelets are an offshoot of the theory of Fourier analysis. Introduced by the French mathematician Joseph Fourier in his essay Theorie analytique de la chaleur (analytic theory of heat), published in Fourier analysis seeks, with great success, to understand complicated phenomena by breaking them into mathematically simple components. The fundamental idea is to take a function and express it as a sum of trigonometric sine and cosine waves of various frequencies and amplitudes. The familiar and well- understood trigonometric functions are easy to analyze. By combining information about a function s sine and cosine components, properties of the function itself are easily deduced, at least in principle. Fourier analysis is among mathematics most widely used theories. It is especially suited to analyzing periodic phenomena, periodicity being the most prominent property of sines and cosines. But even so, the theory has its limitations and its pitfalls. The main problem is that finding detailed information about a function requires looking at a huge number of its infinitely many Fourier components. For example, a transient blip obvious in a graph, is impossible to recognize from its effect on a single component. The reason, in essence, is that each sine and cosine wave undulates infinitely in both directions: thus a single wave can t help locate anything. Indeed the sharper the blip, the more Fourier components are needed to describe it. Wavelet theory takes a different approach. Instead of working with the infinitely undulating sine and cosine waves, wavelet analysis relies on translations and dilations of a suitably chosen mother wavelet that is concentrated in a finite interval. Almost any function can serve as the mother wavelet: this makes wavelet theory more flexible than traditional Fourier analysis. Daughter wavelets are formed by translating, or shifting, the mother wavelet by unit steps and by contracting or expanding it by powers of two (see Figure 1.3). One then expresses other functions as combinations of wavelets,

32 18 Chapter 1. Literature review Figure 1.3: A mother wavelet and two daughters just as Fourier analysis represents functions by combining sines and cosines. The fact that the mother wavelet is concentrated in a finite interval gives wavelet theory its zoom-in capability:an interesting blip in a function can be analyzed by looking at increasingly contracted copies of the mother wavelet in the vicinity of the blip. Many of the ideas underlying wavelet theory have been around for decades, but the subject itself got off the ground only recently. The story starts in the early 1980s in France, when wavelets were introduced by geophysicist Jean Morlet and mathematical physicist Alexander Grossmann. In 1985, mathematician Yves Meyer constructed a family of wavelets with two highly desirable mathematical properties called smoothness and orthogonality.(interestingly, J. O. Stromberg at the University of Tromso in Norway had constructed such a family several years earlier, but the connection with the nascent theory of wavelets was not realized until after Meyer s work.) The following year, Meyer and Stephane Mallat gave the subject a solid foundation with a theory of multiresolution analysis. Then in 1987, Daubechies constructed a family of wavelet that, in addition to being smooth and orthogonal, were identically zero outside a finite interval. Daubechies s construction opened up the field. Compactly supported wavelets are now easy to come by, and are

33 among the most commonly used in applications. And applications are abundant. Wavelets are being tested for use in everything from digital image enhancement- making blurry pictures sharp- to new methods in numerical analysis (itself widely used in scientific computing). They re a very versatile tool says Daubechies. Not all the applications will pan out, but many will, and some already have. There are some very nice success stories Daubechies adds. One such story may have far- reaching effects, especially for the next generation of criminals. The Federal Bureau of Investigation has adopted a wavelet-based standard for computerizing its fingerprint files. The FBI has around 200 million fingerprint cards on file, according to Peter Higgins, is to digitize the files, store them electronically, and put [them] in something that would fit in a foot room. It sounds easy: after all, entire encyclopedias now fit on a compact disk with room to spare. But that s words. Images are something else. At a resolution of 500 pixels per inch. a standard fingerprint card contains nearly 10 megabytes of data. Transmitting that much information over a modem-something the police would like to be able to do takes hours at today s transmission rates...what s needed is some way to compress the data on a fingerprint card without distorting the picture. That s where wavelets come in. By treating the fingerprint image as a two- dimensional function, it s possible to represent it with a combination of wavelets. With a suitably chosen family of wavelets, only a relative handful are needed to represent a fingerprint, and the contribution of each wavelet can be rounded off, or quantized, which reduces the amount of data that needs to be stored or transmitted... 19

34 20 Chapter 1. Literature review 1.3 Multiresolution analysis Multiresolution curve The multiresolution techniques and the use of hierarchy have a long history in CG. In particular, the multiresolution plays a fundamental role for CAD curves representation as B-spline. This technique is a certain way of handling cubic B-splines, which allows to do many things, that are not possible or very complicated with spline techniques. Some of the key-features of multiresolution curves are: smoothing through changing the level of resolution editing the overall sweep of the curve without changing its character editing the character of the curve without changing its overall sweep The key idea of multiresolution curves is to take cubic B-spline control points and apply filter bank decomposition from multiresolution analysis. This means defining a filter-bank: a set of matrices presenting averaging scheme for each level of resolution. By applying decomposition matrices to the initial control polygon we get the control polygon on the lowest level and a set of detail coefficients for every successful level. By applying reconstruction matrices on the latter you can get the control points of the curve at any level. In order to understand better the working mechanism underlying this technique, in the following section we provide an overview of the multiresolution analysis applied to curves. A function or a signal can be viewed as composed by a smooth background and some fluctuations or details on top of it. The distinction between the smooth part and the details is determined by the resolution, that is, by the level below which the details of a signal cannot be discerned. At a given resolution, a function is approximated by ignoring all fluctuations below the resolution scale. We can imagine to progressively increase the resolution: at each stage of the increase in the resolution, finer details are added to the coarser description, providing successively better approximations to the original function. In our case, given a B-spline curve f(u) with m control points, a multiresolution framework constructs the approximating curve with the least squared error using m control points with m < m. We consider that these

35 21 are endpoint-interpolating uniform B-spline curves. We summarize the multiresolution framework considering the general case. Let C n be a discrete signal expressed as a column vector of samples c n 1, cn 2,.., cn m C n = [c n 1, c n 2,.., c n m] T, that in our application are the control points of the curve. We want to construct a low-resolution version C n 1 of C n with a number of samples m < m. The process for creating the m samples of C n 1 uses some form of filtering and down-sampling that can be expressed by the following matrix equation: C n 1 = A n C n, (1.3.1) where A n is an m m matrix. The detail D n 1 lost in this filtering process can be captured by the following equation: D n 1 = B n C n, (1.3.2) where B n is a (m m ) m matrix which is related to the matrix A n. This process, that splits C n into a low-resolution version C n 1 and detail D n 1, is called decomposition. If A n and B n are correctly chosen, we can reconstruct the initial signal C n using another pair of matrices P n and Q n called synthesis filters, as follows: C n = P n C n 1 + Q n D n 1. (1.3.3) The process is called reconstruction. If we recursively apply the same splitting procedure to the signal C n 1, we obtain a hierarchy of lower-resolution signals C 0, C 1,...,C n 1 and details D 0, D 1,...,D n 1. This recursive process is known as a filter bank (Figure 1.4). So, C n can be recovered from the sequence C 0, D 0, D 1,...,D n 1. This transformation is known as a wavelet transform. All that is needed for a wavelet transform is an appropriate set of analysis and synthesis filters A j, B j, P j and Q j. To calculate these filters, we associate with each signal C n (for the B-spline curves these are the vectors of control points), a functions f n (u), with u [0, 1] given by: f n (u) = φ n C n,

36 22 Chapter 1. Literature review Figure 1.4: The filter bank where φ n is a row matrix of basis functions called scaling function that are the endpoint-interpolating B-splines basis functions for the curves. These functions posses an important property: they have to be refinable; that is, for all j [0, n] : φ j 1 = φ j P j. (1.3.4) In other words, each scaling function at level j 1 must be expressible as a linear combination of finer scaling functions at level j. Next, let V j be the linear space spanned by the set of scaling functions j. The refinement condition on j implies that these linear spaces are nested. If we choose an proper inner product for the basis functions in V j we are able to define W j as the orthogonal complement of V j in V j+1. The basis functions j of the space W j, called wavelets, are such that φ j and ψ j together form a basis for V j+1. We can now construct the synthesis filter Q j as the matrix that satisfies: ψ j 1 = φ j Q j. (1.3.5) The equations and can be expressed as a single equation by concatenating the matrices together: [Φ j 1 Ψ j 1 ] = Φ j [P j Q j ] The analysis filters A j and B j instead, are formed by the matrices satisfying the inverse relation: [ ] A [Φ j 1 Ψ j 1 j ] = Φ j By this two matrix equations we can write the following relation: [ ] A j = [P j Q j ] 1 B j B j

37 [ ] A where j and [P j Q j ] 1 are both square matrices. B j We have seen an overview on wavelet and multiresolution analysis that we will use in the second part of this thesis when we analyze the smoothing and segmentation phase in the sketch curve phases. To construct multiresolution curve procedure we need that the work space have particular property as for example that the spaces of the basis functions are nested. As we have seen in the section 1.1, the basis functions of the B-spline curve are defined recursively and hence they have this property. Furthermore the fact that the B-spline basis functions are locally supported, influence the sparsity of the refinement matrix P j. These and other property make B-spline curve representation suitable for wavelet and multiresolution analysis. Now, we can see in more detail how, all these mathematical entity, are used in the two research fields presented in this thesis. 23

38 24 Chapter 1. Literature review

39 Chapter 2 Part one: B-spline Curve Approximation with Optimal Knots 2.1 Introduction This chapter concerns with an algorithm for constructing suitable configuration of knot sets for the linear B-splines. The aim is to determine optimal positions for the knots, in order to approximate arbitrary functions in the L 1 norm. Starting from some known results on the approximation of strictly convex functions with linear splines, we construct linear approximations for not convex functions and plane curves. Furthermore, we apply the proposed approach to approximate cubic B-splines with optimal knots and to achieved a better curve approximation after knots removal. Some numerical experiments that illustrating the performance of the presented algorithm are also showed. In particular we extend to a not convex function the L 1 approximation of strictly convex functions by means of second order splines, and then we present some applications of this extension. The section 2.2 gives an overview of the problem, already studied by [18], subsequently, the section 2.3 and 2.4 are devoted to the extension of linear approximations to a not convex functions and plane curves, respectively. The section 2.5 and 2.6 are dedicated to applications of the methods described

40 26 Chapter 2. Approximation with Optimal Knots in the previous sections, to obtain better cubic B-spline approximations after some knots removal. Finally, in the chapter 3 some numerical examples are provided. 2.2 Preliminaries Let [a, b] an interval on the real axis and let S 2 (U) be the space of the second order spline with U = {u 0,...,u n+1 } set of knots in [a, b], with a = u 0 = u 1 < < u n = u n+1 = b and with the B-spline basis functions B 1 0,...,B1 n 1. Let C(t) S 2 (U) be a linear B-spline with knots set U, then we can rewrite it as follows: n 1 C(t) = α i Bi 1 (t) where α i are coefficients. The problem we are going to tackle can we formalize as follows. i=0 Problem 1. Let f be a function, f C[a, b], we want to approximate f by second order spline functions, i.e., we want to find a C (t) with knots set U such that: b a f(x) C (t) dx b a f(x) C(t) dx for all set of knots U in [a, b] and functions C(t) S 2 (U). Firstly, we recall the results obtained in [14] and [18]. In these works a preliminary solution at the Problem 1 is proposed by considering f to be strictly convex function in [a, b]. The optimal L 1 approximation straight line can be determined easily with the following result: