Monitoring Grinding Wheel Redress-life Using Support Vector Machines

Size: px
Start display at page:

Download "Monitoring Grinding Wheel Redress-life Using Support Vector Machines"

Transcription

1 International Journal of Automation and Computing 1 (2006) Monitoring Grinding Wheel Redress-life Using Support Vector Machines Xun Chen, Thitikorn Limchimchol School of Mechanical, Materials and Manufacturing Engineering, University of Nottingham, Nottingham NG7 2RD, UK Abstract: Condition monitoring is a very important aspect in automated manufacturing processes. Any malfunction of a machining process will deteriorate production quality and efficiency. This paper presents an application of support vector machines in grinding process monitoring. The paper starts with an overview of grinding behaviour. Grinding force is analysed through a Short Time Fourier Transform (STFT) to identify features for condition monitoring. The Support Vector Machine (SVM) methodology is introduced as a powerful tool for the classification of different wheel wear situations. After training with available signal data, the SVM is able to identify the state of a grinding process. The requirement and strategy for using SVM for grinding process monitoring is discussed, while the result of the example illustrates how effective SVMs can be in determining wheel redress-life. Keywords: Monitoring, grinding, support vector machine. 1 Introduction Condition monitoring is widely used in the manufacturing industry. In a machining process the variation of tool life due to different tool wear performance has a great impact on production quality, productivity, and cost. Reliable process monitoring tools are of fundamental importance to critical component machining processes, especially in the aerospace industry. Condition monitoring can be divided into two categories (1) direct and (2) indirect. The direct method generally involves determining tool wear directly from tool surface observation and measurement. Using metrological measurement, computer vision, and/or image processing, etc. Indirect methods monitor tool wear by sensing the physical behaviour of a machining process, which can include changes in force, vibration, and temperature, etc. In this paper, indirect monitoring is investigated for grinding wheel redress-life monitoring. Traditional machining monitoring, focuses on the average values of monitored signals as a time function. Signal features in the frequency domain are also commonly considered. To improve the accuracy of monitoring, artificial intelligence such as neural networks, fuzzy logic, or other pattern recognition techniques, have been applied [1 4]. However, the use of a neural network depends on the proper selection of the amount of training data, and the type of network structure, of Manuscript received March 1, 2005; revised September 28, Corresponding author. address: xun.chen@nottingham.ac.uk which the training process is a tedious job, and often relies on a trial and error approach. The recent developments of SVM [5 10], and Least Square Support Vector Machines (LS-SVM) [11], have been successfully applied to feature classifications in different fields. Using SVMs to judge the redress-life of a grinding wheel during grinding, would provide a rational test in developing a reliable tool for grinding process monitoring. This paper reports on an investigation of grinding process monitoring, using LS-SVM to analyse grinding force signals. Grinding force signals are analysed in both time, and frequency domains, using a Short Time Fourier Transform (STFT) analysis to create a power spectrum over time. These timefrequency domain methods offer a clear illustration of the features of grinding system performance. They demonstrate that the characteristics of grinding force extracted by a STFT can be used as input for a SVM. Good judgement of grinding wheel life using LS-SVM classification has been achieved. The paper is organized as follows. Grinding chatter and force characteristics are briefly described in section 2. In section 3, feature analysis by STFT is introduced, followed by the principles of SVMs in section 4, experimental results are discussed in section 5, while conclusions are given in section 6. 2 Grinding process characteristics Grinding performance characteristics can be related to the shape of grinding chips, which are influenced by a large number of parameters. Fundamentally, wheel speed, work speed, and the distribution of cutting edges

2 Xun Chen et al./ Monitoring Grinding Wheel Redress-life Using Support Vector Machines 57 on a wheel surface will determine the shape of grinding chips. A material removal rate can be expressed by an equivalent chip thickness. However, the distribution of a cutting edge on a wheel surface, varies continually, due to the effects of the dressing operation, and the nature of the wheel wear process. Wheel wear is a complex process, which includes cutting edge attritional wear, and the fracturing of grits and bonding materials. Because of the random distribution of grits in a wheel space, some of the most extrusive grits may wear quickly and form large plateaus on their surface. This causes large forces to act on them. Self-sharpening occurs due to the fracturing of grits or bonds. The influence of such wear behaviour can reflect on grinding forces, which consist of static and dynamic components. Static force relates to average material removal, while dynamic force refers to vibrations occurring in response to persistent disturbance, such as wheel, or workpiece imbalance, wheel run out, uneven grit wear distribution or other imbalanced rotating components of the grinding machine. Grinding chatter, also known as self-excited vibration, is a harmful phenomenon that can cause excessive dynamic forces leading to unacceptable wheel wear, and in extreme cases causes catastrophic disasters. Grinding chatter usually develops gradually, due to grinding wheel wear. Chatter makes a wheel surface uneven, resulting in poor surface quality, and low machining productivity. A dressing operation is often required to restore good wheel cutting ability. Therefore, judging wheel redress-life is an important issue in a grinding operation. a spectrogram is created when a window position is shifted by one or several measured values. The time characteristics of the process can be presented by repeating the Fourier transform for each window position. Although STFT has a fixed frequency resolution for all frequencies, once the size of a window is chosen, it enables an easier interpretation in terms of harmonics, and is faster in comparison to other methods [12]. The mathematical model of STFT is: STFT(t, ω) = s(τ)γ t,ω (τ t)e jωτ dτ. (1) Because the window function γ(t) has a short time duration, the Fourier transform of s(τ)γ(τ t) reflects the signal s local frequency properties. By moving γ(t) and repeating the same process, we can see how the signal s frequency contents evolve over time. However, there is a trade off in the selection of time and frequency resolution. If γ(t) is chosen to have a good time resolution, then its frequency resolution must be reduced, and vice versa. Equality only holds when γ(t) is a Gaussian function [13]. Fig.1 shows the results of a STFT analysis of grinding forces, where grinding depth of cut is 1 mm. The effect of grinding wear over a time-frequency domain, can easily be identified from the results to enable grinding wheel condition to be monitored in relation to force signal. It can be seen that some features in the force frequency spectrum increase during each grinding. 3 Process feature analysis Grinding force signals can be used to detect the development of chatter in grinding, because dynamic grinding forces represent the reaction of the grinding system to vibration. A Fourier transform is commonly used to analyse vibration behaviour in a frequency domain. However, for an unstable process, a Fourier transform cannot indicate how process features will change over time. In recent years, jointed timefrequency analysis has become popular as a method to overcome the drawback of a conventional Fourier transform. A STFT is a popular method for time-frequency analysis. The basic idea of a STFF, is to split a non stationary signal, into segments in a time domain by the proper selection of a window function; and then to carry out a Fourier transform on each of these segments separately. This process delivers an instantaneous spectrum. STFT decomposes time-varying signals into time-frequency domain components; hence Fig.1 Signals over a time-frequency domain for 4 grinding cuts after filtering with a band pass Chebchev II filter The objective of using STFT is to unify information from both a time and frequency domain, in order

3 58 International Journal of Automation and Computing 1 (2006) to provide more detailed information suitable for classification algorithms. 4 Support vector machines SVMs have been recognised as powerful machine learning tools, with good theoretical properties for convergence and generalisation. They were first introduced by Vapnik in the late 1960s [14] on the foundation of statistical learning theory; which is a general mathematical framework for estimating dependencies from empirical and finite data sets. The basic idea of a SVM is to determine a classifier machine that minimizes structural risk consisting of empirical error, and the complexity of a model leading to good generalization error. It can deal with both binary problems and multi-class problems. A classification problem, can be restricted to the consideration of a two-class problem without loss of generality. The aim is to separate two classes by a function induced from available examples, and produce a classifier that will work well on unseen examples. Assuming data to be classified is linearly separable, there will be many possible linear classifiers or functions that can be used to separate the data; but there is only one linear function that maximizes margin. A hyperplane can be defined using a number of support vectors, which can draw a boundary between the two classes. In non-linear cases, the use of support vectors allows complex boundaries to be created. Through the minimisation of a quadratic programming problem, the margin of separation between each class can be maximised. Nearest data points are used to define the margin, and are known as support vectors. Once support vectors contain all needed information, the SVM function then becomes a classifier. 4.1 Basic principle of support vector machines A SVM can be considered as simply creating a line, or a hyperplane, between two sets of data, as shown in Fig.2. It attempts to place a linear boundary between two different classes of data, and orientate it in such a way that margin is maximized. In other words, it is used to maximize the distance between the nearest data points, or boundary, of each class. A boundary is then placed in the middle of the margin between the two classes. Therefore the problem becomes: Minimize 1 2 w 2 (2) Subject to y i ((w x i ) + b 0, i = 1,,l (3) where the weighting vector w defines the direction of the separating hyperplane f(x), and b (bias), defines the distance of the hyperplane from the origin. The problem can be solved by using a Lagrange multiplier, as given in equation 4: L(w, b, α) = 1 m 2 (w w) α i [y i ((w i x i ) + b) 1]. (4) j=1 Therefore the optimal problem in (2) is equivalent to the maximization of the objective function shown in (5). Maximize: Fig.2 A hyperplane classifier towards a non-separable data set L(α) = Subject to: α i 1 2 y i y j α i α j (x i x j ) (5) i,j=1 y i α i = 0, α i 0, i = 1,,l. (6) The problem of classifying a new data point x, is solved simply by looking at the value of the following hyperplane decision function: f(x) = sign(w x + b ) (7) where the weight vector w, is calculated from function (8): w = y i α i x i (8)

4 Xun Chen et al./ Monitoring Grinding Wheel Redress-life Using Support Vector Machines 59 and b has to be calculated by making use of primal constraints, due to it s appearance in the dual problem in (9): b = max y i= 1( w x i ) + min y( w x i ). 2 (9) An unknown data example x is then classified as follows: { Class I, if f(x) > 0 x. (10) Class II, otherwise So far training data is assumed to be linearly separable. In cases where training data cannot be linearly separated, as in the example shown in Fig.2, non-negative slack variables ξ i are introduced to form equations 11 and 12, so as to produce a non-linear problem. In equation 11, the sum of slack variables is multiplied by a parameter C, which is chosen by a user. A larger C corresponds to a higher penalty for errors. This corresponds to the addition of an upper bound C to α i. In both cases, the decision function in (equation 7) is equivalent, and given by: Minimize: 1 2 w 2 + C ξi k (11) Subject to: y i ((w x i ) + b) 1 ξ i, ξ i 0, i = 1,,l. (12) Then an unknown data example x is classified as follows: { Class I, if f(x) > 0 x. (13) Class II, otherwise The above SVM classifier is an important concept for the analysis and construction of more complicated SVMs. 4.2 Nonlinear kernel mapping In the case where a linear boundary is inappropriate, the transformation of vector x into a higher dimensional feature space is required. The transformation into a higher-dimensional feature space requires relatively intensive computation. It is possible to calculate a kernel which is the inner products of a feature space, in an original data space i K(x i, x j ) = Φ(x i )Φ(x j ). (14) The idea of a kernel function, is to enable operations to be performed in an input space, rather than in a high dimension feature space. It is not necessary to know an actual mapping function Φ, hence there is no need to evaluate an inner product in the feature. Therefore in this case, a dot product (x i x j ) can be replaced with K(x i, x j ) in the algorithm. The SVM computes a value for α i that corresponds to the maximal margin hyperplane in the feature space, by replacing different kernel functions in (x i x j ). There are some common examples of kernel functions for mapping vectors in feature spaces. These include: Radial Basis Function kernel Polynomial Kernel Sigmoid function K(x i, x j ) = e xi xj 2 /2σ 2 (15) K(x i, x j ) = (x i x j + 1) d (16) K(x i, x j ) = tanh(x i x j θ). (17) In which the decision function will be: { } f(x) = sign α i y j K(x i, x j ) + b. (18) In this case, the unknown data example is classified in the following way: { Class I, if f(x) = 1 x Class II, if f(x) = 1. (19) 4.3 Least square support vector machines An original SVM, may not be suitable in practice, due to its time consumption during the computation of quadratic programming. A least square SVM, was developed by Suykens and Vandewalle for solving pattern recognition and non-linear function estimation problems [15]. The SVM equation modification developed by Suykens, is as follows: Minimize: 1 2 w 2 + C 1 ξi 2 (20) 2 Subject to: y i ((w x i ) + b) = 1 ξ i, ξ i 0, i = 1,,l. (21) The classifier in a dual space, is similar to the standard SVM case. { } f(x) = sign α i y j K(x i, x j ) + b i (22) Where α i are Lagrangian multipliers. The application of conditions for optimality yield the following linear KKT (Karush-Kuhn-Tucker) system: [ 0 y T y Ω + C 1 I ] [ ] b α [ 0 = 1 v ]. (23)

5 60 International Journal of Automation and Computing 1 (2006) Where: Ω = Z T Z, Z T = (y 1 Φ(x 1 ),, y n Φ(x n )), Y T = (y 1,, y n ), 1 v = (1,,1) and α = (α 1,, α n ). Then: Ω = ψ(x i, x l ) = Φ(x i ) T Φ(x l ), i, l = 1,,N. (24) By applying the kernel to the Ω matrix in equation 23, classifier function estimation becomes: { } f(x) = sign α i y j K(x i, x j ) + b. (25) The Vapnik formulation is modified here in two ways. First, instead of the inequality constraints (equation 21), one takes equality constraints, in which the value 1 on the right hand side is considered as a target, rather than a threshold value. Upon this target value, an error variable ξ i is applied, such that misclassifications can be tolerated in the case of overlapping distributions. These error variables play a similar role to the slack variable ξ i, in SVM formulations. Second, a squared loss function, as shown in equation 20 is taken for the error variable, as these modifications will greatly simplify the problem [11]. LS-SVM, offers most of the properties of the original SVM, such as great generalization capacity. Nonlinear problems can be solved by mapping data into a high dimension feature space using kernel methods. It is excellent for classifying a problem with an unseen data example. However, the greatest advantage of the LS-SVM is faster computational time, which is a key requirement for online condition monitoring. 5 Grinding process monitoring using SVM A set of grinding experiments were carried out on a Makino A55 CNC machine centre. A workpiece was ground using a VIPER wheel. Grinding depth of cut was 1 mm; grinding speed 35 m/s; and workpiece speed 1000 mm/min. Workpiece material was Inconel 718. Grinding forces were recorded using a LABVIEW program and data analysed using programs written within a MATLAB environment. Signal features extracted using a STFT program were sent to the SVM program to classify grinding conditions. A 3D view of the STFT spectrums of grinding force during 4 sequential grinding cuts, are illustrated in Fig.3. It can be seen that the feature frequency components of dynamic forces, increase with grinding time. The first classification test in the trials, was to identify air cutting, and actual grinding, grinding force signals. These were obtained by applying a moving average method to remove high frequency components of grinding forces. Analysis was carried out using a MATLAB LS-SVM toolbox [15]. A Radial Basis Function (RBF) kernel was selected for classification. This method can distinguish air cutting and actual grinding clearly, as shown in Fig.4, where the LS-SVM gives 1 for air cutting and 1 for actual grinding. The results from both training, and test sets, are completely satisfactory. Surprisingly, the method coped well with environmental noise, and the disturbance of coolant dynamic force did not affect its judgement. Fig.3 A 3D spectrogram of normal grinding force components during 4 sequential cuts Fig.4 Grinding detection using SVM Once actual grinding took place, another SVM classification program was employed to monitor the condition of the grinding wheel. The input signals of the SVM were, grinding forces, grinding power, and dynamic features extracted from grinding forces. The dynamic features of grinding forces were taken by using a STFT program. Force signals were pre-processed using a Chebychev II band-pass filter to reduce the influence

6 Xun Chen et al./ Monitoring Grinding Wheel Redress-life Using Support Vector Machines 61 of noise. The Radial Basis Function kernel was used in this SVM monitoring process. Fig.5 shows projections of the monitored force, power signals, and STFT spectrum, as grinding time functions during 4 grinding cuts. The output of the SVM, which is plotted on the lower part of the graph, clearly indicates the development of grinding chatter. The value 3 indicates good wheel condition, while a value 1 highlights the presence of grinding chatter. redress-life, as shown in Fig.6. In this experiment, grinding chatter developed intermittently. During the 4 th cut, chatter occurrence was greater than 50%. Therefore, the wheel should have been redressed after the 4 th cut, before continuous chatter occurred. The longer redress-life of the wheel was due to the lower grinding force generated at a higher grinding speed. Further experiments using different grinding conditions, (wheel speed: m/s, depth of cut: 1 2 mm and work speed: 1 2 m/min), also indicate that the SVM tool is a feasible method with which to monitor grinding wheel life. Fig.5 Grinding chatter monitoring using SVM It can be seen from Fig.5 that the development of grinding chatter is not an instantaneous event. A certain time period is required before continuous chatter is established. This is because the development of grinding chatter is the result of grinding wheel wear. As mentioned previously, grinding wheel wear involves two phenomena, attritious wear causing blunt cutting edges, and fracture wear creating sharp cutting edges. The sharpness of a grinding wheel depends on the equilibrant situation of different wear mechanisms. An occasional presence of grinding chatter does not require the redressing of a grinding wheel. However, continuous grinding chatter is dangerous to a grinding operation. It is rational to define that a greater than 50% level of chatter in one grinding cut, is an indicator of the end of a wheel s redress-life. Therefore, a SVM can be used for grinding wheel life monitoring. This is validated by the results illustrated in Fig.5. During a second grinding cut, chatter presence was 5%, which meant that grinding was normal for the remainder of the grinding operation. However, as chatter presence in the third cut was 55%, it indicates that the grinding wheel requires redressing. Without redressing, grinding chatter will occur continuously, as shown in Fig.5. If grinding wheel speed is increased to 55 m/s, a SVM can still provide a good indication of wheel Fig.6 Grinding chatter monitoring using SVM 6 Conclusions Condition monitoring using SVMs is feasible, and can ensure consistent production quality. In this paper, it has been successfully demonstrated that grinding process performance can be monitored, and identified, using a LS-SVM algorithm. Test results are satisfactory, since a LS-SVM can give good classification with a small quantity of training data and time. Using a decision support algorithm, the behaviour of a grinding process can be seen to relate to grinding wheel condition. In future work, more sensors will be applied to study chatter, and other defects which can occur during the grinding process, to provide more accurate process information. The development of a real-time remote diagnostic system, will provide manufacturers with precise and reliable information for managing and conducting manufacturing activities. References [1] H. Y. Kim, S. R. Kim, J. H. Ahn, S. H. Kim. Process monitoring of centerless grinding using acoustic emission. Journal of Materials Processing Technology, vol. 111, no. 1-3, pp , [2] Janez Gradisek, Andreas Baus, Edvard Govekar, Fritz Klocke, Igor Grabec. Automatic chatter detection in grinding. International Journal of Machine Tools and Manufac-

7 62 International Journal of Automation and Computing 1 (2006) ture, vol. 43, no. 14, pp , [3] Pawel Lezanski. An intelligent system for grinding wheel condition monitoring. Journal of Materials Processing Technology, vol. 109, no. 3, pp , [4] X. Chen, W. B. Rowe, Y. Li, B. Mills. Grinding Vibration Detection Using a Neural Network. the Journal of Engineering Manufacture, Proceedings of IMechE Part B, vol. 210, B4, , [5] B. Samanta. Gear fault detection using artificial neural networks and support vector machines with generic algorithms. Mechanical Systems and Signal Processing, vol. 18, no. 3, pp , [6] Lijuan Cao. Support Vector Machines experts for time series forecasting. Neurocomputing, vol. 51, pp , [7] M. A. Mohandes, T. O. Halawani, S. Rehman, Ahmed A. Hussain. Support vector machines for wind speed prediction. Renewable Energy, vol. 29, no. 6, pp , [8] Cosimo Distante, Nicola Ancona, Pietro Siciliano. Support vector machines for olfactory signals recognition. Sensors and Actuators, vol. B, no. 88, pp , [9] Yingjie Wang, Chin-Seng Chua, Yeong-Khing Ho. Facial feature detection and face recognition from 2D and 3D images. Pattern Recognition Letters, vol. 23, no. 10, pp , [10] Steve R. Gunn. Support Vector Machines for Classification and Regression. Technical Report, School of Electronics and Computer Science, Faculty of Engineering and Applied Science and Department of Electronics and Computer Science, [11] J. A. K. Suykens, T. V. Gestel, J. D. Brabanter, B. D. Moor, J. Vandewalle. Least squares support vector machines, World Sciencetific Publishing Co. Pte. Ltd, Singapore, [12] M. Kemal Kiymik, Inan Guler, Alper Dizibuyuk, Mehmet Akin. Comparison of STFT and wavelet transform methods in determining epileptic seizure activity in EEG signals for real-time application. Computers in Biology and Medicine, vol. 35, no. 7, pp , [13] S. Qian, D. Chen. Joint time-frequency analysis: methods and applications, Prentice Hall Inc, Upper Saddle River, NJ, [14] Vladimir N. Vapnik. The Nature of Statistical Learning Theory, Springer-Verlag New York, Inc., New York, USA [15] K. Pelckman, J. A. K. Suykens, T. V. Gestel, J. D Brabanter, L. Lukas, B. Hamers, B. D. Moor, J. Vandewalle. A Matlab/c toolbox for least square support vector machines. ESAT-SCD-SISTA Technical Report Xun Chen received his B. Eng. degress from Fuzhou University. He received his M. Sc. degree from Zhejiang University and his Ph. D. degree from Liverpool John Moores University. He has been a visiting professor to Fuzhou University since Dr. Chen has published more than 100 research papers. He is a founder member of the International Committee of Abrasive Technology. Before his employment at Nottingham, Dr. Chen was a lecturer of Mechanical Engineering at the University of Dundee. Prior to that, he was a research fellow, a Royal Society Royal Fellow at Liverpool John Moores University and a lecturer at Fuzhou University. His research interests include advanced manufacturing technology including application of computer science, mechatronics and artificial intelligence to manufacturing process monitoring and control, particularly to the high efficiency precision grinding. Application. Thitikorn Limchimchol received his B. Eng. (honour) degree in manufacturing engineering from University of Nottingham in United Kingdom in Currently he is undertaking his doctorial study on manufacturing engineering in the University of Nottingham. His main research interests include Grinding Technology, Artificial Intelligence, Support Vector Machines, Genetic Algorithm, and Java

Support Vector Machines Explained

Support Vector Machines Explained March 1, 2009 Support Vector Machines Explained Tristan Fletcher www.cs.ucl.ac.uk/staff/t.fletcher/ Introduction This document has been written in an attempt to make the Support Vector Machines (SVM),

More information

Support Vector Machine (SVM)

Support Vector Machine (SVM) Support Vector Machine (SVM) CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Margin concept Hard-Margin SVM Soft-Margin SVM Dual Problems of Hard-Margin

More information

Introduction to Support Vector Machines. Colin Campbell, Bristol University

Introduction to Support Vector Machines. Colin Campbell, Bristol University Introduction to Support Vector Machines Colin Campbell, Bristol University 1 Outline of talk. Part 1. An Introduction to SVMs 1.1. SVMs for binary classification. 1.2. Soft margins and multi-class classification.

More information

A Simple Introduction to Support Vector Machines

A Simple Introduction to Support Vector Machines A Simple Introduction to Support Vector Machines Martin Law Lecture for CSE 802 Department of Computer Science and Engineering Michigan State University Outline A brief history of SVM Large-margin linear

More information

Support Vector Machines for Classification and Regression

Support Vector Machines for Classification and Regression UNIVERSITY OF SOUTHAMPTON Support Vector Machines for Classification and Regression by Steve R. Gunn Technical Report Faculty of Engineering, Science and Mathematics School of Electronics and Computer

More information

A Health Degree Evaluation Algorithm for Equipment Based on Fuzzy Sets and the Improved SVM

A Health Degree Evaluation Algorithm for Equipment Based on Fuzzy Sets and the Improved SVM Journal of Computational Information Systems 10: 17 (2014) 7629 7635 Available at http://www.jofcis.com A Health Degree Evaluation Algorithm for Equipment Based on Fuzzy Sets and the Improved SVM Tian

More information

Machine Learning in FX Carry Basket Prediction

Machine Learning in FX Carry Basket Prediction Machine Learning in FX Carry Basket Prediction Tristan Fletcher, Fabian Redpath and Joe D Alessandro Abstract Artificial Neural Networks ANN), Support Vector Machines SVM) and Relevance Vector Machines

More information

Support Vector Machines with Clustering for Training with Very Large Datasets

Support Vector Machines with Clustering for Training with Very Large Datasets Support Vector Machines with Clustering for Training with Very Large Datasets Theodoros Evgeniou Technology Management INSEAD Bd de Constance, Fontainebleau 77300, France theodoros.evgeniou@insead.fr Massimiliano

More information

A Study on the Comparison of Electricity Forecasting Models: Korea and China

A Study on the Comparison of Electricity Forecasting Models: Korea and China Communications for Statistical Applications and Methods 2015, Vol. 22, No. 6, 675 683 DOI: http://dx.doi.org/10.5351/csam.2015.22.6.675 Print ISSN 2287-7843 / Online ISSN 2383-4757 A Study on the Comparison

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Charlie Frogner 1 MIT 2011 1 Slides mostly stolen from Ryan Rifkin (Google). Plan Regularization derivation of SVMs. Analyzing the SVM problem: optimization, duality. Geometric

More information

Class #6: Non-linear classification. ML4Bio 2012 February 17 th, 2012 Quaid Morris

Class #6: Non-linear classification. ML4Bio 2012 February 17 th, 2012 Quaid Morris Class #6: Non-linear classification ML4Bio 2012 February 17 th, 2012 Quaid Morris 1 Module #: Title of Module 2 Review Overview Linear separability Non-linear classification Linear Support Vector Machines

More information

Fuzzy Cognitive Map for Software Testing Using Artificial Intelligence Techniques

Fuzzy Cognitive Map for Software Testing Using Artificial Intelligence Techniques Fuzzy ognitive Map for Software Testing Using Artificial Intelligence Techniques Deane Larkman 1, Masoud Mohammadian 1, Bala Balachandran 1, Ric Jentzsch 2 1 Faculty of Information Science and Engineering,

More information

Using artificial intelligence for data reduction in mechanical engineering

Using artificial intelligence for data reduction in mechanical engineering Using artificial intelligence for data reduction in mechanical engineering L. Mdlazi 1, C.J. Stander 1, P.S. Heyns 1, T. Marwala 2 1 Dynamic Systems Group Department of Mechanical and Aeronautical Engineering,

More information

A fast multi-class SVM learning method for huge databases

A fast multi-class SVM learning method for huge databases www.ijcsi.org 544 A fast multi-class SVM learning method for huge databases Djeffal Abdelhamid 1, Babahenini Mohamed Chaouki 2 and Taleb-Ahmed Abdelmalik 3 1,2 Computer science department, LESIA Laboratory,

More information

Artificial Neural Networks and Support Vector Machines. CS 486/686: Introduction to Artificial Intelligence

Artificial Neural Networks and Support Vector Machines. CS 486/686: Introduction to Artificial Intelligence Artificial Neural Networks and Support Vector Machines CS 486/686: Introduction to Artificial Intelligence 1 Outline What is a Neural Network? - Perceptron learners - Multi-layer networks What is a Support

More information

Big Data - Lecture 1 Optimization reminders

Big Data - Lecture 1 Optimization reminders Big Data - Lecture 1 Optimization reminders S. Gadat Toulouse, Octobre 2014 Big Data - Lecture 1 Optimization reminders S. Gadat Toulouse, Octobre 2014 Schedule Introduction Major issues Examples Mathematics

More information

Machine Learning and Pattern Recognition Logistic Regression

Machine Learning and Pattern Recognition Logistic Regression Machine Learning and Pattern Recognition Logistic Regression Course Lecturer:Amos J Storkey Institute for Adaptive and Neural Computation School of Informatics University of Edinburgh Crichton Street,

More information

Support Vector Machine. Tutorial. (and Statistical Learning Theory)

Support Vector Machine. Tutorial. (and Statistical Learning Theory) Support Vector Machine (and Statistical Learning Theory) Tutorial Jason Weston NEC Labs America 4 Independence Way, Princeton, USA. jasonw@nec-labs.com 1 Support Vector Machines: history SVMs introduced

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical

More information

A Fuzzy System Approach of Feed Rate Determination for CNC Milling

A Fuzzy System Approach of Feed Rate Determination for CNC Milling A Fuzzy System Approach of Determination for CNC Milling Zhibin Miao Department of Mechanical and Electrical Engineering Heilongjiang Institute of Technology Harbin, China e-mail:miaozhibin99@yahoo.com.cn

More information

Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network

Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Qian Wu, Yahui Wang, Long Zhang and Li Shen Abstract Building electrical system fault diagnosis is the

More information

Figure 1. Experimental setup for the proposed MLR-IPSRR system.

Figure 1. Experimental setup for the proposed MLR-IPSRR system. Figure 1. Experimental setup for the proposed MLR-IPSRR system. 99 The hardware included: A Fadal vertical CNC milling machine with multiple tool changing and a 15 HP spindle. A Kistler 9257B type dynamometer

More information

Electroencephalography Analysis Using Neural Network and Support Vector Machine during Sleep

Electroencephalography Analysis Using Neural Network and Support Vector Machine during Sleep Engineering, 23, 5, 88-92 doi:.4236/eng.23.55b8 Published Online May 23 (http://www.scirp.org/journal/eng) Electroencephalography Analysis Using Neural Network and Support Vector Machine during Sleep JeeEun

More information

Online Classification on a Budget

Online Classification on a Budget Online Classification on a Budget Koby Crammer Computer Sci. & Eng. Hebrew University Jerusalem 91904, Israel kobics@cs.huji.ac.il Jaz Kandola Royal Holloway, University of London Egham, UK jaz@cs.rhul.ac.uk

More information

PROCESS MONITORING AND CONTROL OF MACHINING OPERATIONS

PROCESS MONITORING AND CONTROL OF MACHINING OPERATIONS PROCESS MONITORING AND CONTROL OF MACHINING OPERATIONS Uche R. 1 and Ebieto C. E. 2 1 Department of Mechanical Engineering, Federal University of Technology, Owerri, Nigeria 2 Department of Mechanical

More information

Analecta Vol. 8, No. 2 ISSN 2064-7964

Analecta Vol. 8, No. 2 ISSN 2064-7964 EXPERIMENTAL APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS IN ENGINEERING PROCESSING SYSTEM S. Dadvandipour Institute of Information Engineering, University of Miskolc, Egyetemváros, 3515, Miskolc, Hungary,

More information

EM Clustering Approach for Multi-Dimensional Analysis of Big Data Set

EM Clustering Approach for Multi-Dimensional Analysis of Big Data Set EM Clustering Approach for Multi-Dimensional Analysis of Big Data Set Amhmed A. Bhih School of Electrical and Electronic Engineering Princy Johnson School of Electrical and Electronic Engineering Martin

More information

Big Data Analytics CSCI 4030

Big Data Analytics CSCI 4030 High dim. data Graph data Infinite data Machine learning Apps Locality sensitive hashing PageRank, SimRank Filtering data streams SVM Recommen der systems Clustering Community Detection Web advertising

More information

Short-time FFT, Multi-taper analysis & Filtering in SPM12

Short-time FFT, Multi-taper analysis & Filtering in SPM12 Short-time FFT, Multi-taper analysis & Filtering in SPM12 Computational Psychiatry Seminar, FS 2015 Daniel Renz, Translational Neuromodeling Unit, ETHZ & UZH 20.03.2015 Overview Refresher Short-time Fourier

More information

THE SVM APPROACH FOR BOX JENKINS MODELS

THE SVM APPROACH FOR BOX JENKINS MODELS REVSTAT Statistical Journal Volume 7, Number 1, April 2009, 23 36 THE SVM APPROACH FOR BOX JENKINS MODELS Authors: Saeid Amiri Dep. of Energy and Technology, Swedish Univ. of Agriculture Sciences, P.O.Box

More information

Several Views of Support Vector Machines

Several Views of Support Vector Machines Several Views of Support Vector Machines Ryan M. Rifkin Honda Research Institute USA, Inc. Human Intention Understanding Group 2007 Tikhonov Regularization We are considering algorithms of the form min

More information

AUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S.

AUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S. AUTOMATION OF ENERGY DEMAND FORECASTING by Sanzad Siddique, B.S. A Thesis submitted to the Faculty of the Graduate School, Marquette University, in Partial Fulfillment of the Requirements for the Degree

More information

Predict Influencers in the Social Network

Predict Influencers in the Social Network Predict Influencers in the Social Network Ruishan Liu, Yang Zhao and Liuyu Zhou Email: rliu2, yzhao2, lyzhou@stanford.edu Department of Electrical Engineering, Stanford University Abstract Given two persons

More information

SPINDLE ERROR MOVEMENTS MEASUREMENT ALGORITHM AND A NEW METHOD OF RESULTS ANALYSIS 1. INTRODUCTION

SPINDLE ERROR MOVEMENTS MEASUREMENT ALGORITHM AND A NEW METHOD OF RESULTS ANALYSIS 1. INTRODUCTION Journal of Machine Engineering, Vol. 15, No.1, 2015 machine tool accuracy, metrology, spindle error motions Krzysztof JEMIELNIAK 1* Jaroslaw CHRZANOWSKI 1 SPINDLE ERROR MOVEMENTS MEASUREMENT ALGORITHM

More information

Knowledge Discovery from patents using KMX Text Analytics

Knowledge Discovery from patents using KMX Text Analytics Knowledge Discovery from patents using KMX Text Analytics Dr. Anton Heijs anton.heijs@treparel.com Treparel Abstract In this white paper we discuss how the KMX technology of Treparel can help searchers

More information

Duality in General Programs. Ryan Tibshirani Convex Optimization 10-725/36-725

Duality in General Programs. Ryan Tibshirani Convex Optimization 10-725/36-725 Duality in General Programs Ryan Tibshirani Convex Optimization 10-725/36-725 1 Last time: duality in linear programs Given c R n, A R m n, b R m, G R r n, h R r : min x R n c T x max u R m, v R r b T

More information

Early defect identification of semiconductor processes using machine learning

Early defect identification of semiconductor processes using machine learning STANFORD UNIVERISTY MACHINE LEARNING CS229 Early defect identification of semiconductor processes using machine learning Friday, December 16, 2011 Authors: Saul ROSA Anton VLADIMIROV Professor: Dr. Andrew

More information

Feature Selection using Integer and Binary coded Genetic Algorithm to improve the performance of SVM Classifier

Feature Selection using Integer and Binary coded Genetic Algorithm to improve the performance of SVM Classifier Feature Selection using Integer and Binary coded Genetic Algorithm to improve the performance of SVM Classifier D.Nithya a, *, V.Suganya b,1, R.Saranya Irudaya Mary c,1 Abstract - This paper presents,

More information

CS 2750 Machine Learning. Lecture 1. Machine Learning. http://www.cs.pitt.edu/~milos/courses/cs2750/ CS 2750 Machine Learning.

CS 2750 Machine Learning. Lecture 1. Machine Learning. http://www.cs.pitt.edu/~milos/courses/cs2750/ CS 2750 Machine Learning. Lecture Machine Learning Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square, x5 http://www.cs.pitt.edu/~milos/courses/cs75/ Administration Instructor: Milos Hauskrecht milos@cs.pitt.edu 539 Sennott

More information

Classification of high resolution satellite images

Classification of high resolution satellite images Thesis for the degree of Master of Science in Engineering Physics Classification of high resolution satellite images Anders Karlsson Laboratoire de Systèmes d Information Géographique Ecole Polytéchnique

More information

A new Approach for Intrusion Detection in Computer Networks Using Data Mining Technique

A new Approach for Intrusion Detection in Computer Networks Using Data Mining Technique A new Approach for Intrusion Detection in Computer Networks Using Data Mining Technique Aida Parbaleh 1, Dr. Heirsh Soltanpanah 2* 1 Department of Computer Engineering, Islamic Azad University, Sanandaj

More information

Nonlinear Programming Methods.S2 Quadratic Programming

Nonlinear Programming Methods.S2 Quadratic Programming Nonlinear Programming Methods.S2 Quadratic Programming Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard A linearly constrained optimization problem with a quadratic objective

More information

Modelling, Extraction and Description of Intrinsic Cues of High Resolution Satellite Images: Independent Component Analysis based approaches

Modelling, Extraction and Description of Intrinsic Cues of High Resolution Satellite Images: Independent Component Analysis based approaches Modelling, Extraction and Description of Intrinsic Cues of High Resolution Satellite Images: Independent Component Analysis based approaches PhD Thesis by Payam Birjandi Director: Prof. Mihai Datcu Problematic

More information

An Introduction to Machine Learning

An Introduction to Machine Learning An Introduction to Machine Learning L5: Novelty Detection and Regression Alexander J. Smola Statistical Machine Learning Program Canberra, ACT 0200 Australia Alex.Smola@nicta.com.au Tata Institute, Pune,

More information

Data clustering optimization with visualization

Data clustering optimization with visualization Page 1 Data clustering optimization with visualization Fabien Guillaume MASTER THESIS IN SOFTWARE ENGINEERING DEPARTMENT OF INFORMATICS UNIVERSITY OF BERGEN NORWAY DEPARTMENT OF COMPUTER ENGINEERING BERGEN

More information

Intrusion Detection via Machine Learning for SCADA System Protection

Intrusion Detection via Machine Learning for SCADA System Protection Intrusion Detection via Machine Learning for SCADA System Protection S.L.P. Yasakethu Department of Computing, University of Surrey, Guildford, GU2 7XH, UK. s.l.yasakethu@surrey.ac.uk J. Jiang Department

More information

THREE DIMENSIONAL REPRESENTATION OF AMINO ACID CHARAC- TERISTICS

THREE DIMENSIONAL REPRESENTATION OF AMINO ACID CHARAC- TERISTICS THREE DIMENSIONAL REPRESENTATION OF AMINO ACID CHARAC- TERISTICS O.U. Sezerman 1, R. Islamaj 2, E. Alpaydin 2 1 Laborotory of Computational Biology, Sabancı University, Istanbul, Turkey. 2 Computer Engineering

More information

Linear smoother. ŷ = S y. where s ij = s ij (x) e.g. s ij = diag(l i (x)) To go the other way, you need to diagonalize S

Linear smoother. ŷ = S y. where s ij = s ij (x) e.g. s ij = diag(l i (x)) To go the other way, you need to diagonalize S Linear smoother ŷ = S y where s ij = s ij (x) e.g. s ij = diag(l i (x)) To go the other way, you need to diagonalize S 2 Online Learning: LMS and Perceptrons Partially adapted from slides by Ryan Gabbard

More information

Application of Support Vector Machines to Fault Diagnosis and Automated Repair

Application of Support Vector Machines to Fault Diagnosis and Automated Repair Application of Support Vector Machines to Fault Diagnosis and Automated Repair C. Saunders and A. Gammerman Royal Holloway, University of London, Egham, Surrey, England {C.Saunders,A.Gammerman}@dcs.rhbnc.ac.uk

More information

Lecture 2: The SVM classifier

Lecture 2: The SVM classifier Lecture 2: The SVM classifier C19 Machine Learning Hilary 2015 A. Zisserman Review of linear classifiers Linear separability Perceptron Support Vector Machine (SVM) classifier Wide margin Cost function

More information

Making Sense of the Mayhem: Machine Learning and March Madness

Making Sense of the Mayhem: Machine Learning and March Madness Making Sense of the Mayhem: Machine Learning and March Madness Alex Tran and Adam Ginzberg Stanford University atran3@stanford.edu ginzberg@stanford.edu I. Introduction III. Model The goal of our research

More information

The Scientific Data Mining Process

The Scientific Data Mining Process Chapter 4 The Scientific Data Mining Process When I use a word, Humpty Dumpty said, in rather a scornful tone, it means just what I choose it to mean neither more nor less. Lewis Carroll [87, p. 214] In

More information

Network Intrusion Detection using Semi Supervised Support Vector Machine

Network Intrusion Detection using Semi Supervised Support Vector Machine Network Intrusion Detection using Semi Supervised Support Vector Machine Jyoti Haweliya Department of Computer Engineering Institute of Engineering & Technology, Devi Ahilya University Indore, India ABSTRACT

More information

Component Ordering in Independent Component Analysis Based on Data Power

Component Ordering in Independent Component Analysis Based on Data Power Component Ordering in Independent Component Analysis Based on Data Power Anne Hendrikse Raymond Veldhuis University of Twente University of Twente Fac. EEMCS, Signals and Systems Group Fac. EEMCS, Signals

More information

E-commerce Transaction Anomaly Classification

E-commerce Transaction Anomaly Classification E-commerce Transaction Anomaly Classification Minyong Lee minyong@stanford.edu Seunghee Ham sham12@stanford.edu Qiyi Jiang qjiang@stanford.edu I. INTRODUCTION Due to the increasing popularity of e-commerce

More information

Acknowledgments. Data Mining with Regression. Data Mining Context. Overview. Colleagues

Acknowledgments. Data Mining with Regression. Data Mining Context. Overview. Colleagues Data Mining with Regression Teaching an old dog some new tricks Acknowledgments Colleagues Dean Foster in Statistics Lyle Ungar in Computer Science Bob Stine Department of Statistics The School of the

More information

GURLS: A Least Squares Library for Supervised Learning

GURLS: A Least Squares Library for Supervised Learning Journal of Machine Learning Research 14 (2013) 3201-3205 Submitted 1/12; Revised 2/13; Published 10/13 GURLS: A Least Squares Library for Supervised Learning Andrea Tacchetti Pavan K. Mallapragada Center

More information

A Simple Feature Extraction Technique of a Pattern By Hopfield Network

A Simple Feature Extraction Technique of a Pattern By Hopfield Network A Simple Feature Extraction Technique of a Pattern By Hopfield Network A.Nag!, S. Biswas *, D. Sarkar *, P.P. Sarkar *, B. Gupta **! Academy of Technology, Hoogly - 722 *USIC, University of Kalyani, Kalyani

More information

Data Mining for Manufacturing: Preventive Maintenance, Failure Prediction, Quality Control

Data Mining for Manufacturing: Preventive Maintenance, Failure Prediction, Quality Control Data Mining for Manufacturing: Preventive Maintenance, Failure Prediction, Quality Control Andre BERGMANN Salzgitter Mannesmann Forschung GmbH; Duisburg, Germany Phone: +49 203 9993154, Fax: +49 203 9993234;

More information

Scalable Developments for Big Data Analytics in Remote Sensing

Scalable Developments for Big Data Analytics in Remote Sensing Scalable Developments for Big Data Analytics in Remote Sensing Federated Systems and Data Division Research Group High Productivity Data Processing Dr.-Ing. Morris Riedel et al. Research Group Leader,

More information

Open Access Research on Application of Neural Network in Computer Network Security Evaluation. Shujuan Jin *

Open Access Research on Application of Neural Network in Computer Network Security Evaluation. Shujuan Jin * Send Orders for Reprints to reprints@benthamscience.ae 766 The Open Electrical & Electronic Engineering Journal, 2014, 8, 766-771 Open Access Research on Application of Neural Network in Computer Network

More information

Maximization versus environmental compliance

Maximization versus environmental compliance Maximization versus environmental compliance Increase use of alternative fuels with no risk for quality and environment Reprint from World Cement March 2005 Dr. Eduardo Gallestey, ABB, Switzerland, discusses

More information

Classifying Large Data Sets Using SVMs with Hierarchical Clusters. Presented by :Limou Wang

Classifying Large Data Sets Using SVMs with Hierarchical Clusters. Presented by :Limou Wang Classifying Large Data Sets Using SVMs with Hierarchical Clusters Presented by :Limou Wang Overview SVM Overview Motivation Hierarchical micro-clustering algorithm Clustering-Based SVM (CB-SVM) Experimental

More information

Forecasting of Economic Quantities using Fuzzy Autoregressive Model and Fuzzy Neural Network

Forecasting of Economic Quantities using Fuzzy Autoregressive Model and Fuzzy Neural Network Forecasting of Economic Quantities using Fuzzy Autoregressive Model and Fuzzy Neural Network Dušan Marček 1 Abstract Most models for the time series of stock prices have centered on autoregressive (AR)

More information

Automatic Fall Detector based on Sliding Window Principle

Automatic Fall Detector based on Sliding Window Principle Automatic Fall Detector based on Sliding Window Principle J. Rodriguez 1, M. Mercuri 2, P. Karsmakers 3,4, P.J. Soh 2, P. Leroux 3,5, and D. Schreurs 2 1 UPC, Div. EETAC-TSC, Castelldefels, Spain 2 KU

More information

Summary of specified general model for CHP system

Summary of specified general model for CHP system Fakulteta za Elektrotehniko Eva Thorin, Heike Brand, Christoph Weber Summary of specified general model for CHP system OSCOGEN Deliverable D1.4 Contract No. ENK5-CT-2000-00094 Project co-funded by the

More information

Machine Learning. CUNY Graduate Center, Spring 2013. Professor Liang Huang. huang@cs.qc.cuny.edu

Machine Learning. CUNY Graduate Center, Spring 2013. Professor Liang Huang. huang@cs.qc.cuny.edu Machine Learning CUNY Graduate Center, Spring 2013 Professor Liang Huang huang@cs.qc.cuny.edu http://acl.cs.qc.edu/~lhuang/teaching/machine-learning Logistics Lectures M 9:30-11:30 am Room 4419 Personnel

More information

Machine Learning Final Project Spam Email Filtering

Machine Learning Final Project Spam Email Filtering Machine Learning Final Project Spam Email Filtering March 2013 Shahar Yifrah Guy Lev Table of Content 1. OVERVIEW... 3 2. DATASET... 3 2.1 SOURCE... 3 2.2 CREATION OF TRAINING AND TEST SETS... 4 2.3 FEATURE

More information

Linear Threshold Units

Linear Threshold Units Linear Threshold Units w x hx (... w n x n w We assume that each feature x j and each weight w j is a real number (we will relax this later) We will study three different algorithms for learning linear

More information

A New Quantitative Behavioral Model for Financial Prediction

A New Quantitative Behavioral Model for Financial Prediction 2011 3rd International Conference on Information and Financial Engineering IPEDR vol.12 (2011) (2011) IACSIT Press, Singapore A New Quantitative Behavioral Model for Financial Prediction Thimmaraya Ramesh

More information

Machine Learning in Spam Filtering

Machine Learning in Spam Filtering Machine Learning in Spam Filtering A Crash Course in ML Konstantin Tretyakov kt@ut.ee Institute of Computer Science, University of Tartu Overview Spam is Evil ML for Spam Filtering: General Idea, Problems.

More information

Open Access A Facial Expression Recognition Algorithm Based on Local Binary Pattern and Empirical Mode Decomposition

Open Access A Facial Expression Recognition Algorithm Based on Local Binary Pattern and Empirical Mode Decomposition Send Orders for Reprints to reprints@benthamscience.ae The Open Electrical & Electronic Engineering Journal, 2014, 8, 599-604 599 Open Access A Facial Expression Recognition Algorithm Based on Local Binary

More information

Local features and matching. Image classification & object localization

Local features and matching. Image classification & object localization Overview Instance level search Local features and matching Efficient visual recognition Image classification & object localization Category recognition Image classification: assigning a class label to

More information

WAVELET ANALYSIS BASED ULTRASONIC NONDESTRUCTIVE TESTING OF POLYMER BONDED EXPLOSIVE

WAVELET ANALYSIS BASED ULTRASONIC NONDESTRUCTIVE TESTING OF POLYMER BONDED EXPLOSIVE WAVELET ANALYSIS BASED ULTRASONIC NONDESTRUCTIVE TESTING OF POLYMER BONDED EXPLOSIVE Weibin Zhang, Yong Tian, Zhanfeng Yang, Liling Wang Institute of Chemical Materials, China Academy of Engineering Physics,

More information

D-optimal plans in observational studies

D-optimal plans in observational studies D-optimal plans in observational studies Constanze Pumplün Stefan Rüping Katharina Morik Claus Weihs October 11, 2005 Abstract This paper investigates the use of Design of Experiments in observational

More information

Introduction. Chapter 1

Introduction. Chapter 1 Chapter 1 Introduction The area of fault detection and diagnosis is one of the most important aspects in process engineering. This area has received considerable attention from industry and academia because

More information

Java Modules for Time Series Analysis

Java Modules for Time Series Analysis Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series

More information

Identification algorithms for hybrid systems

Identification algorithms for hybrid systems Identification algorithms for hybrid systems Giancarlo Ferrari-Trecate Modeling paradigms Chemistry White box Thermodynamics System Mechanics... Drawbacks: Parameter values of components must be known

More information

An Experimental Study of the Performance of Histogram Equalization for Image Enhancement

An Experimental Study of the Performance of Histogram Equalization for Image Enhancement International Journal of Computer Sciences and Engineering Open Access Research Paper Volume-4, Special Issue-2, April 216 E-ISSN: 2347-2693 An Experimental Study of the Performance of Histogram Equalization

More information

4.6 Linear Programming duality

4.6 Linear Programming duality 4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP. Different spaces and objective functions but in general same optimal

More information

Comparison of K-means and Backpropagation Data Mining Algorithms

Comparison of K-means and Backpropagation Data Mining Algorithms Comparison of K-means and Backpropagation Data Mining Algorithms Nitu Mathuriya, Dr. Ashish Bansal Abstract Data mining has got more and more mature as a field of basic research in computer science and

More information

A Novel Method to Improve Resolution of Satellite Images Using DWT and Interpolation

A Novel Method to Improve Resolution of Satellite Images Using DWT and Interpolation A Novel Method to Improve Resolution of Satellite Images Using DWT and Interpolation S.VENKATA RAMANA ¹, S. NARAYANA REDDY ² M.Tech student, Department of ECE, SVU college of Engineering, Tirupati, 517502,

More information

Optimization Modeling for Mining Engineers

Optimization Modeling for Mining Engineers Optimization Modeling for Mining Engineers Alexandra M. Newman Division of Economics and Business Slide 1 Colorado School of Mines Seminar Outline Linear Programming Integer Linear Programming Slide 2

More information

SVM Ensemble Model for Investment Prediction

SVM Ensemble Model for Investment Prediction 19 SVM Ensemble Model for Investment Prediction Chandra J, Assistant Professor, Department of Computer Science, Christ University, Bangalore Siji T. Mathew, Research Scholar, Christ University, Dept of

More information

The relation between news events and stock price jump: an analysis based on neural network

The relation between news events and stock price jump: an analysis based on neural network 20th International Congress on Modelling and Simulation, Adelaide, Australia, 1 6 December 2013 www.mssanz.org.au/modsim2013 The relation between news events and stock price jump: an analysis based on

More information

COMPARISON OF OBJECT BASED AND PIXEL BASED CLASSIFICATION OF HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS

COMPARISON OF OBJECT BASED AND PIXEL BASED CLASSIFICATION OF HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS COMPARISON OF OBJECT BASED AND PIXEL BASED CLASSIFICATION OF HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS B.K. Mohan and S. N. Ladha Centre for Studies in Resources Engineering IIT

More information

Current Standard: Mathematical Concepts and Applications Shape, Space, and Measurement- Primary

Current Standard: Mathematical Concepts and Applications Shape, Space, and Measurement- Primary Shape, Space, and Measurement- Primary A student shall apply concepts of shape, space, and measurement to solve problems involving two- and three-dimensional shapes by demonstrating an understanding of:

More information

Multiple Kernel Learning on the Limit Order Book

Multiple Kernel Learning on the Limit Order Book JMLR: Workshop and Conference Proceedings 11 (2010) 167 174 Workshop on Applications of Pattern Analysis Multiple Kernel Learning on the Limit Order Book Tristan Fletcher Zakria Hussain John Shawe-Taylor

More information

Artificial Neural Network for Speech Recognition

Artificial Neural Network for Speech Recognition Artificial Neural Network for Speech Recognition Austin Marshall March 3, 2005 2nd Annual Student Research Showcase Overview Presenting an Artificial Neural Network to recognize and classify speech Spoken

More information

Simultaneous Gamma Correction and Registration in the Frequency Domain

Simultaneous Gamma Correction and Registration in the Frequency Domain Simultaneous Gamma Correction and Registration in the Frequency Domain Alexander Wong a28wong@uwaterloo.ca William Bishop wdbishop@uwaterloo.ca Department of Electrical and Computer Engineering University

More information

Chapter 12 Discovering New Knowledge Data Mining

Chapter 12 Discovering New Knowledge Data Mining Chapter 12 Discovering New Knowledge Data Mining Becerra-Fernandez, et al. -- Knowledge Management 1/e -- 2004 Prentice Hall Additional material 2007 Dekai Wu Chapter Objectives Introduce the student to

More information

Logistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression

Logistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression Logistic Regression Department of Statistics The Pennsylvania State University Email: jiali@stat.psu.edu Logistic Regression Preserve linear classification boundaries. By the Bayes rule: Ĝ(x) = arg max

More information

Measuring Line Edge Roughness: Fluctuations in Uncertainty

Measuring Line Edge Roughness: Fluctuations in Uncertainty Tutor6.doc: Version 5/6/08 T h e L i t h o g r a p h y E x p e r t (August 008) Measuring Line Edge Roughness: Fluctuations in Uncertainty Line edge roughness () is the deviation of a feature edge (as

More information

Blood Vessel Classification into Arteries and Veins in Retinal Images

Blood Vessel Classification into Arteries and Veins in Retinal Images Blood Vessel Classification into Arteries and Veins in Retinal Images Claudia Kondermann and Daniel Kondermann a and Michelle Yan b a Interdisciplinary Center for Scientific Computing (IWR), University

More information

Wireless Sensor Networks Coverage Optimization based on Improved AFSA Algorithm

Wireless Sensor Networks Coverage Optimization based on Improved AFSA Algorithm , pp. 99-108 http://dx.doi.org/10.1457/ijfgcn.015.8.1.11 Wireless Sensor Networks Coverage Optimization based on Improved AFSA Algorithm Wang DaWei and Wang Changliang Zhejiang Industry Polytechnic College

More information

INTRUSION DETECTION USING THE SUPPORT VECTOR MACHINE ENHANCED WITH A FEATURE-WEIGHT KERNEL

INTRUSION DETECTION USING THE SUPPORT VECTOR MACHINE ENHANCED WITH A FEATURE-WEIGHT KERNEL INTRUSION DETECTION USING THE SUPPORT VECTOR MACHINE ENHANCED WITH A FEATURE-WEIGHT KERNEL A Thesis Submitted to the Faculty of Graduate Studies and Research In Partial Fulfillment of the Requirements

More information

CHARACTERISTICS IN FLIGHT DATA ESTIMATION WITH LOGISTIC REGRESSION AND SUPPORT VECTOR MACHINES

CHARACTERISTICS IN FLIGHT DATA ESTIMATION WITH LOGISTIC REGRESSION AND SUPPORT VECTOR MACHINES CHARACTERISTICS IN FLIGHT DATA ESTIMATION WITH LOGISTIC REGRESSION AND SUPPORT VECTOR MACHINES Claus Gwiggner, Ecole Polytechnique, LIX, Palaiseau, France Gert Lanckriet, University of Berkeley, EECS,

More information

Search Taxonomy. Web Search. Search Engine Optimization. Information Retrieval

Search Taxonomy. Web Search. Search Engine Optimization. Information Retrieval Information Retrieval INFO 4300 / CS 4300! Retrieval models Older models» Boolean retrieval» Vector Space model Probabilistic Models» BM25» Language models Web search» Learning to Rank Search Taxonomy!

More information

Classification algorithm in Data mining: An Overview

Classification algorithm in Data mining: An Overview Classification algorithm in Data mining: An Overview S.Neelamegam #1, Dr.E.Ramaraj *2 #1 M.phil Scholar, Department of Computer Science and Engineering, Alagappa University, Karaikudi. *2 Professor, Department

More information

A Linear Programming Approach to Novelty Detection

A Linear Programming Approach to Novelty Detection A Linear Programming Approach to Novelty Detection Colin Campbell Dept. of Engineering Mathematics, Bristol University, Bristol Bristol, BS8 1 TR, United Kingdon C. Campbell@bris.ac.uk Kristin P. Bennett

More information