UNIVERSITY OF BOLTON SCHOOL OF ENGINEERING MS SYSTEMS ENGINEERING AND ENGINEERING MANAGEMENT SEMESTER 1 EXAMINATION 2015/2016 INTELLIGENT SYSTEMS

Size: px
Start display at page:

Download "UNIVERSITY OF BOLTON SCHOOL OF ENGINEERING MS SYSTEMS ENGINEERING AND ENGINEERING MANAGEMENT SEMESTER 1 EXAMINATION 2015/2016 INTELLIGENT SYSTEMS"

Transcription

1 TW72 UNIVERSITY OF BOLTON SCHOOL OF ENGINEERING MS SYSTEMS ENGINEERING AND ENGINEERING MANAGEMENT SEMESTER 1 EXAMINATION 2015/2016 INTELLIGENT SYSTEMS MODULE NO: EEM7010 Date: Monday 11 th January 2016 Time: INSTRUCTIONS TO CANDIDATES: There are 5 questions. Answer any 3 questions. All questions carry equal marks. Individual marks are shown within the question.

2 Page 2 of 8 Question 1 This question relates to the supervised neural network a) Describe following two supervised learning algorithms and supported by their algorithm formulae: a back propagation (BP) neural network a Hebbian neural network. b) Consider the two prototype patterns shown in Figure Q1(b). i) Check if these two patterns are orthogonal. (3 marks) ii) Normalise the input P1 (2 marks) iii) Use the Hebb rule to design an autoassociator network that will recognise these two patterns and determine the weight matrix. (6 marks) iv) Find the response of the network to the pattern. (4 marks) P1 P2 Pt Figure Q1(b) PLEASE TURN THE PAGE

3 Page 3 of 8 Question 2 This question relates to the unsupervised learning neural network a) Compare and contrast the Hebbian unsupervised learning algorithm with competition or the winner-takes-all learning algorithm. b) A Kohonen network receives the input pattern P P = and with three neurons in the network which have weights W1 = , W2 = , W3 = Using the winner-takes-all learning algorithm to determine the neuron that will have its weights adjusted (4 marks) the new values of the weights, suppose that the learning coefficient is 0.3. (3 marks) the architecture of the Kohonen Network (with the assistance of a diagram) and explain its working principles. (8 marks) PLEASE TURN THE PAGE

4 Page 4 of 8 Question 3 This question relates to a self organising map (SOM) neural network a) Using sketches to identify the difference between a pattern space and a feature space and explain the importance to map a pattern space into a feature space in SOM neural network. (7 marks) b) The details of a 1D mathematical model for self organisation in a system of 8 neurons are given in Appendix 1. Plot by hand the output of neuron s activation function versus the input (net) and discuss the mathematical form for the recursive equations. c) The resulting response for the 1D mathematical model of self organisation in Appendix 1, for a system consisting of 8 neurons is shown below, in Table Q3 (c). In Table Q3 (c), the excitations of all the 8 neurons, for 12 time steps, are presented. Sketch a sequence of graphs, on the same axes, showing the spatial response at subsequent times, for time steps t = (0, 4,12). Discuss how this model displays self organisation? (8 marks) Table Q3 (c) Step y1 y2 y3 y4 y5 y6 y7 y PLEASE TURN THE PAGE

5 Page 5 of 8 Question 4 This question relates to a self organising map (SOM) neural network a) Discuss the following main aspects of the algorithm for the Kohonen self organising map (SOM) i) the best matching node (BMN) m ii) ii) the neighbourhood (Nm) of the BMN and its spatial extent as training progresses the weight update rule for the SOM iv) the Gaussian form for the learning function = (N i, t) b) The following figure (Figure Q5 (b)) shows the final weights of a selforganising feature map that has been trained for the following conditions: twodimensional input vectors have been uniformly distributed over the triangular area and the self organising array consisted of 15 neurons. Lines between points connect topological neighbours only; points indicate weight coordinates. Sketch the diagram of the network that, in your opinion, has undergone self organisation. Label inputs, neurons, and weights for the computational experiment, results of which are reported on the figure. Suggest the initial weight values that may have been used. (15 marks) Figure Q5 (b) PLEASE TURN THE PAGE

6 Page 6 of 8 Question 5 This question relates to the application of artificial intelligent neural networks a) Give one application example for using supervised learning and one application example for using unsupervised leaning and Explain their learning and training processes. b) Data for a CMOS heart rate monitoring IC has been taken from 17 production lots with 63 process control parameters (PCMs) logged and a SOM used to analyse the correlations in the data. The trained SOM is shown in figure below. Discuss the relationships in the PCMs gleaned from the SOM. (a) Device yield (b) NMOS transistor drain current (c )Aluminium sheet resistance, (d) Metal layer 1 to metal layer 2 contact resistance (e) Production lot numbers. Figure: the component planes for the trained SOM illustrating the IC yield dependence on CMOS process control parameters. In the SOM dark gray relates to a small parameter value and light gray to a large value. Question 5 continued over the page

7 Page 7 of 8 Question 5 continued c) Given the fab uses N type wafers, why, is an abnormal value of the NMOS drain current likely to be a more important than a consideration of the PMOS drain current, in determining IC yield. (5 marks) END OF QUESTIONS

8 Page 8 of 8 APPENDICES Appendix 1 A 1D Mathematical Model of Self Organisation The response of the i th neuron is given by recursive equation: k 0 y ( t 1) f ( x ( t 1) y ( t) ) i i kk 0 The initial excitation is given by: ik 3 ( i 3) x i ( t) 0.5sin [ ], for i = 1, 2,, 8 15 The neuron s activation function is given by: k 0, net 0 f(net) net, 0 net 3 3, net 3 b = 0.5, c = 0.2 The 1D neural network architecture is shown below and a discretised Mexican top hat function form for the feedback coefficients k. Figure Q3 Question b) (a) The 1D array of neurons. (b) The feedback coefficients k are shown as a function of inter neuronal distance.

Lecture 8 Artificial neural networks: Unsupervised learning

Lecture 8 Artificial neural networks: Unsupervised learning Lecture 8 Artificial neural networks: Unsupervised learning Introduction Hebbian learning Generalised Hebbian learning algorithm Competitive learning Self-organising computational map: Kohonen network

More information

Self Organizing Maps: Fundamentals

Self Organizing Maps: Fundamentals Self Organizing Maps: Fundamentals Introduction to Neural Networks : Lecture 16 John A. Bullinaria, 2004 1. What is a Self Organizing Map? 2. Topographic Maps 3. Setting up a Self Organizing Map 4. Kohonen

More information

Visualization of Breast Cancer Data by SOM Component Planes

Visualization of Breast Cancer Data by SOM Component Planes International Journal of Science and Technology Volume 3 No. 2, February, 2014 Visualization of Breast Cancer Data by SOM Component Planes P.Venkatesan. 1, M.Mullai 2 1 Department of Statistics,NIRT(Indian

More information

CONNECTIONIST THEORIES OF LEARNING

CONNECTIONIST THEORIES OF LEARNING CONNECTIONIST THEORIES OF LEARNING Themis N. Karaminis, Michael S.C. Thomas Department of Psychological Sciences, Birkbeck College, University of London London, WC1E 7HX UK tkaram01@students.bbk.ac.uk,

More information

Neural Networks Kohonen Self-Organizing Maps

Neural Networks Kohonen Self-Organizing Maps Neural Networks Kohonen Self-Organizing Maps Mohamed Krini Christian-Albrechts-Universität zu Kiel Faculty of Engineering Institute of Electrical and Information Engineering Digital Signal Processing and

More information

A TUTORIAL. BY: Negin Yousefpour PhD Student Civil Engineering Department TEXAS A&M UNIVERSITY

A TUTORIAL. BY: Negin Yousefpour PhD Student Civil Engineering Department TEXAS A&M UNIVERSITY ARTIFICIAL NEURAL NETWORKS: A TUTORIAL BY: Negin Yousefpour PhD Student Civil Engineering Department TEXAS A&M UNIVERSITY Contents Introduction Origin Of Neural Network Biological Neural Networks ANN Overview

More information

USING SELF-ORGANISING MAPS FOR ANOMALOUS BEHAVIOUR DETECTION IN A COMPUTER FORENSIC INVESTIGATION

USING SELF-ORGANISING MAPS FOR ANOMALOUS BEHAVIOUR DETECTION IN A COMPUTER FORENSIC INVESTIGATION USING SELF-ORGANISING MAPS FOR ANOMALOUS BEHAVIOUR DETECTION IN A COMPUTER FORENSIC INVESTIGATION B.K.L. Fei, J.H.P. Eloff, M.S. Olivier, H.M. Tillwick and H.S. Venter Information and Computer Security

More information

Neural Networks. Neural network is a network or circuit of neurons. Neurons can be. Biological neurons Artificial neurons

Neural Networks. Neural network is a network or circuit of neurons. Neurons can be. Biological neurons Artificial neurons Neural Networks Neural network is a network or circuit of neurons Neurons can be Biological neurons Artificial neurons Biological neurons Building block of the brain Human brain contains over 10 billion

More information

Introduction to Neural Networks : Revision Lectures

Introduction to Neural Networks : Revision Lectures Introduction to Neural Networks : Revision Lectures John A. Bullinaria, 2004 1. Module Aims and Learning Outcomes 2. Biological and Artificial Neural Networks 3. Training Methods for Multi Layer Perceptrons

More information

Lecture 1: Introduction to Neural Networks Kevin Swingler / Bruce Graham

Lecture 1: Introduction to Neural Networks Kevin Swingler / Bruce Graham Lecture 1: Introduction to Neural Networks Kevin Swingler / Bruce Graham kms@cs.stir.ac.uk 1 What are Neural Networks? Neural Networks are networks of neurons, for example, as found in real (i.e. biological)

More information

Comparison of Supervised and Unsupervised Learning Classifiers for Travel Recommendations

Comparison of Supervised and Unsupervised Learning Classifiers for Travel Recommendations Volume 3, No. 8, August 2012 Journal of Global Research in Computer Science REVIEW ARTICLE Available Online at www.jgrcs.info Comparison of Supervised and Unsupervised Learning Classifiers for Travel Recommendations

More information

SELF-ORGANISING MAPPING NETWORKS (SOM) WITH SAS E-MINER

SELF-ORGANISING MAPPING NETWORKS (SOM) WITH SAS E-MINER SELF-ORGANISING MAPPING NETWORKS (SOM) WITH SAS E-MINER C.Sarada, K.Alivelu and Lakshmi Prayaga Directorate of Oilseeds Research, Rajendranagar, Hyderabad saradac@yahoo.com Self Organising mapping networks

More information

Classication with Kohonen Self-Organizing Maps

Classication with Kohonen Self-Organizing Maps Classication with Kohonen Self-Organizing Maps Mia Louise Westerlund Soft Computing, Haskoli Islands, April 24, 2005 1 Introduction 1.1 Background A neural network is dened in [1] as a set of nodes connected

More information

Direct Methods for Solving Linear Systems. Linear Systems of Equations

Direct Methods for Solving Linear Systems. Linear Systems of Equations Direct Methods for Solving Linear Systems Linear Systems of Equations Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University

More information

Data Mining on Sequences with recursive Self-Organizing Maps

Data Mining on Sequences with recursive Self-Organizing Maps Data Mining on Sequences with recursive Self-Organizing Maps Sebastian Blohm Universität Osnabrück sebastian@blomega.de Bachelor's Thesis International Bachelor Program in Cognitive Science, Universität

More information

Recursive Data Structures

Recursive Data Structures Recursive Data Structures Computer scientists often encounter data structures that are defined recursively Trees (Chapter 8) are defined recursively Linked list can be described as a recursive data structure

More information

EFFICIENT DATA PRE-PROCESSING FOR DATA MINING

EFFICIENT DATA PRE-PROCESSING FOR DATA MINING EFFICIENT DATA PRE-PROCESSING FOR DATA MINING USING NEURAL NETWORKS JothiKumar.R 1, Sivabalan.R.V 2 1 Research scholar, Noorul Islam University, Nagercoil, India Assistant Professor, Adhiparasakthi College

More information

High dimensional Data visualization and clustering using Self Organizing Maps

High dimensional Data visualization and clustering using Self Organizing Maps High dimensional Data visualization and clustering using Self Organizing Maps Oliver Bernhardt oliver.bernhardt@fh-hagenberg.at Department of Medical- and Bioinformatics Upper Austria University of Applied

More information

Neural Networks algorithms and applications

Neural Networks algorithms and applications Neural Networks algorithms and applications By Fiona Nielsen 4i 12/12-2001 Supervisor: Geert Rasmussen Niels Brock Business College 1 Introduction Neural Networks is a field of Artificial Intelligence

More information

Data Mining and Neural Networks in Stata

Data Mining and Neural Networks in Stata Data Mining and Neural Networks in Stata 2 nd Italian Stata Users Group Meeting Milano, 10 October 2005 Mario Lucchini e Maurizo Pisati Università di Milano-Bicocca mario.lucchini@unimib.it maurizio.pisati@unimib.it

More information

Chapter 12 Discovering New Knowledge Data Mining

Chapter 12 Discovering New Knowledge Data Mining Chapter 12 Discovering New Knowledge Data Mining Becerra-Fernandez, et al. -- Knowledge Management 1/e -- 2004 Prentice Hall Additional material 2007 Dekai Wu Chapter Objectives Introduce the student to

More information

Credit Card Fraud Detection Using Self Organised Map

Credit Card Fraud Detection Using Self Organised Map International Journal of Information & Computation Technology. ISSN 0974-2239 Volume 4, Number 13 (2014), pp. 1343-1348 International Research Publications House http://www. irphouse.com Credit Card Fraud

More information

Learning. Artificial Intelligence. Learning. Types of Learning. Inductive Learning Method. Inductive Learning. Learning.

Learning. Artificial Intelligence. Learning. Types of Learning. Inductive Learning Method. Inductive Learning. Learning. Learning Learning is essential for unknown environments, i.e., when designer lacks omniscience Artificial Intelligence Learning Chapter 8 Learning is useful as a system construction method, i.e., expose

More information

A New Approach for Compressing Color Images using Neural Network

A New Approach for Compressing Color Images using Neural Network A New Approach for Compressing Color Images using Neural Network A. K. M. Ashikur Rahman and Chowdhury Mofizur Rahman Department of Computer Science and Engineering Bangladesh University of Engineering

More information

Layout Based Visualization Techniques for Multi Dimensional Data

Layout Based Visualization Techniques for Multi Dimensional Data Layout Based Visualization Techniques for Multi Dimensional Data Wim de Leeuw Robert van Liere Center for Mathematics and Computer Science, CWI Amsterdam, the Netherlands wimc,robertl @cwi.nl October 27,

More information

Mobile Phone APP Software Browsing Behavior using Clustering Analysis

Mobile Phone APP Software Browsing Behavior using Clustering Analysis Proceedings of the 2014 International Conference on Industrial Engineering and Operations Management Bali, Indonesia, January 7 9, 2014 Mobile Phone APP Software Browsing Behavior using Clustering Analysis

More information

Classification of Engineering Consultancy Firms Using Self-Organizing Maps: A Scientific Approach

Classification of Engineering Consultancy Firms Using Self-Organizing Maps: A Scientific Approach International Journal of Civil & Environmental Engineering IJCEE-IJENS Vol:13 No:03 46 Classification of Engineering Consultancy Firms Using Self-Organizing Maps: A Scientific Approach Mansour N. Jadid

More information

Neural network software tool development: exploring programming language options

Neural network software tool development: exploring programming language options INEB- PSI Technical Report 2006-1 Neural network software tool development: exploring programming language options Alexandra Oliveira aao@fe.up.pt Supervisor: Professor Joaquim Marques de Sá June 2006

More information

6.2.8 Neural networks for data mining

6.2.8 Neural networks for data mining 6.2.8 Neural networks for data mining Walter Kosters 1 In many application areas neural networks are known to be valuable tools. This also holds for data mining. In this chapter we discuss the use of neural

More information

Advanced Higher Mathematics Course Assessment Specification (C747 77)

Advanced Higher Mathematics Course Assessment Specification (C747 77) Advanced Higher Mathematics Course Assessment Specification (C747 77) Valid from August 2015 This edition: April 2016, version 2.4 This specification may be reproduced in whole or in part for educational

More information

An Introduction to Neural Networks

An Introduction to Neural Networks An Introduction to Vincent Cheung Kevin Cannons Signal & Data Compression Laboratory Electrical & Computer Engineering University of Manitoba Winnipeg, Manitoba, Canada Advisor: Dr. W. Kinsner May 27,

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks 2nd Year UG, MSc in Computer Science http://www.cs.bham.ac.uk/~jxb/inn.html Lecturer: Dr. John A. Bullinaria http://www.cs.bham.ac.uk/~jxb John A. Bullinaria, 2004 Module

More information

Introduction to Neural Computation. Neural Computation

Introduction to Neural Computation. Neural Computation Introduction to Neural Computation Level 4/M Neural Computation Level 3 Website: http://www.cs.bham.ac.uk/~jxb/inc.html Lecturer: Dr. John A. Bullinaria John A. Bullinaria, 2015 Module Administration and

More information

Designing a neural network for forecasting financial time series

Designing a neural network for forecasting financial time series Designing a neural network for forecasting financial time series 29 février 2008 What a Neural Network is? Each neurone k is characterized by a transfer function f k : output k = f k ( i w ik x k ) From

More information

Digital image processing

Digital image processing 746A27 Remote Sensing and GIS Lecture 4 Digital image processing Chandan Roy Guest Lecturer Department of Computer and Information Science Linköping University Digital Image Processing Most of the common

More information

Development of a Network Configuration Management System Using Artificial Neural Networks

Development of a Network Configuration Management System Using Artificial Neural Networks Development of a Network Configuration Management System Using Artificial Neural Networks R. Ramiah*, E. Gemikonakli, and O. Gemikonakli** *MSc Computer Network Management, **Tutor and Head of Department

More information

Role of Neural network in data mining

Role of Neural network in data mining Role of Neural network in data mining Chitranjanjit kaur Associate Prof Guru Nanak College, Sukhchainana Phagwara,(GNDU) Punjab, India Pooja kapoor Associate Prof Swami Sarvanand Group Of Institutes Dinanagar(PTU)

More information

Data Mining Techniques Chapter 7: Artificial Neural Networks

Data Mining Techniques Chapter 7: Artificial Neural Networks Data Mining Techniques Chapter 7: Artificial Neural Networks Artificial Neural Networks.................................................. 2 Neural network example...................................................

More information

CHAPTER 5 PREDICTIVE MODELING STUDIES TO DETERMINE THE CONVEYING VELOCITY OF PARTS ON VIBRATORY FEEDER

CHAPTER 5 PREDICTIVE MODELING STUDIES TO DETERMINE THE CONVEYING VELOCITY OF PARTS ON VIBRATORY FEEDER 93 CHAPTER 5 PREDICTIVE MODELING STUDIES TO DETERMINE THE CONVEYING VELOCITY OF PARTS ON VIBRATORY FEEDER 5.1 INTRODUCTION The development of an active trap based feeder for handling brakeliners was discussed

More information

4.1. Title: data analysis (systems analysis). 4.2. Annotation of educational discipline: educational discipline includes in itself the mastery of the

4.1. Title: data analysis (systems analysis). 4.2. Annotation of educational discipline: educational discipline includes in itself the mastery of the 4.1. Title: data analysis (systems analysis). 4.4. Term of study: 7th semester. 4.1. Title: data analysis (applied mathematics). 4.4. Term of study: 6th semester. 4.1. Title: data analysis (computer science).

More information

degrees of freedom and are able to adapt to the task they are supposed to do [Gupta].

degrees of freedom and are able to adapt to the task they are supposed to do [Gupta]. 1.3 Neural Networks 19 Neural Networks are large structured systems of equations. These systems have many degrees of freedom and are able to adapt to the task they are supposed to do [Gupta]. Two very

More information

/SOLUTIONS/ where a, b, c and d are positive constants. Study the stability of the equilibria of this system based on linearization.

/SOLUTIONS/ where a, b, c and d are positive constants. Study the stability of the equilibria of this system based on linearization. echnische Universiteit Eindhoven Faculteit Elektrotechniek NIE-LINEAIRE SYSEMEN / NEURALE NEWERKEN (P6) gehouden op donderdag maart 7, van 9: tot : uur. Dit examenonderdeel bestaat uit 8 opgaven. /SOLUIONS/

More information

THE HUMAN BRAIN. observations and foundations

THE HUMAN BRAIN. observations and foundations THE HUMAN BRAIN observations and foundations brains versus computers a typical brain contains something like 100 billion miniscule cells called neurons estimates go from about 50 billion to as many as

More information

Studying the Quality of Resistance Spot Welding Joints Using Self-Organising Maps

Studying the Quality of Resistance Spot Welding Joints Using Self-Organising Maps Studying the Quality of Resistance Spot Welding Joints Using Self-Organising Maps Heli Junno, Perttu Laurinen, Lauri Tuovinen and Juha Röning Intelligent Systems Group, Department of Electrical and Information

More information

4. Factor polynomials over complex numbers, describe geometrically, and apply to real-world situations. 5. Determine and apply relationships among syn

4. Factor polynomials over complex numbers, describe geometrically, and apply to real-world situations. 5. Determine and apply relationships among syn I The Real and Complex Number Systems 1. Identify subsets of complex numbers, and compare their structural characteristics. 2. Compare and contrast the properties of real numbers with the properties of

More information

Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network

Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Qian Wu, Yahui Wang, Long Zhang and Li Shen Abstract Building electrical system fault diagnosis is the

More information

CHAPTER 6 NEURAL NETWORK BASED SURFACE ROUGHNESS ESTIMATION

CHAPTER 6 NEURAL NETWORK BASED SURFACE ROUGHNESS ESTIMATION CHAPTER 6 NEURAL NETWORK BASED SURFACE ROUGHNESS ESTIMATION 6.1. KNOWLEDGE REPRESENTATION The function of any representation scheme is to capture the essential features of a problem domain and make that

More information

Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations

Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations Christian W. Frey 2012 Monitoring of Complex Industrial Processes based on Self-Organizing Maps and

More information

M10/5/MATME/SP2/ENG/TZ1/XX+ mathematics. Thursday 6 May 2010 (morning) Candidate session number. 1 hour 30 minutes. instructions to candidates

M10/5/MATME/SP2/ENG/TZ1/XX+ mathematics. Thursday 6 May 2010 (morning) Candidate session number. 1 hour 30 minutes. instructions to candidates 22107304 mathematics STANDARD level Paper 2 Thursday 6 May 2010 (morning) 1 hour 30 minutes 0 0 Candidate session number instructions to candidates Write your session number in the boxes above. Do not

More information

10.3 POWER METHOD FOR APPROXIMATING EIGENVALUES

10.3 POWER METHOD FOR APPROXIMATING EIGENVALUES 55 CHAPTER NUMERICAL METHODS. POWER METHOD FOR APPROXIMATING EIGENVALUES In Chapter 7 we saw that the eigenvalues of an n n matrix A are obtained by solving its characteristic equation n c n n c n n...

More information

Using Artificial Intelligence and Machine Learning Techniques. Some Preliminary Ideas. Presentation to CWiPP 1/8/2013 ICOSS Mark Tomlinson

Using Artificial Intelligence and Machine Learning Techniques. Some Preliminary Ideas. Presentation to CWiPP 1/8/2013 ICOSS Mark Tomlinson Using Artificial Intelligence and Machine Learning Techniques. Some Preliminary Ideas. Presentation to CWiPP 1/8/2013 ICOSS Mark Tomlinson Artificial Intelligence Models Very experimental, but timely?

More information

Intelligent Recognition Technology using Artificial Neural Network for Graphics

Intelligent Recognition Technology using Artificial Neural Network for Graphics Intelligent Recognition Technology using Artificial Neural Network for Graphics FAN Bin 1, ZENG Xiao-Jing *2,a, ZHAO Zhu 3 1,2,3 College of Information technology and Media HeXi University, Zhangye 734000,

More information

An Introduction to Artificial Neural Networks (ANN) - Methods, Abstraction, and Usage

An Introduction to Artificial Neural Networks (ANN) - Methods, Abstraction, and Usage An Introduction to Artificial Neural Networks (ANN) - Methods, Abstraction, and Usage Introduction An artificial neural network (ANN) reflects a system that is based on operations of biological neural

More information

Neural Network Architectures

Neural Network Architectures 6 Neural Network Architectures Bogdan M. Wilamowski Auburn University 6. Introduction... 6-6. Special Easy-to-Train Neural Network Architectures... 6- Polynomial Networks Functional Link Networks Sarajedini

More information

10.4 APPLICATIONS OF NUMERICAL METHODS Applications of Gaussian Elimination with Pivoting

10.4 APPLICATIONS OF NUMERICAL METHODS Applications of Gaussian Elimination with Pivoting 59 CHAPTER NUMERICAL METHODS. APPLICATIONS OF NUMERICAL METHODS Applications of Gaussian Elimination with Pivoting In Section.5 you used least squares regression analysis to find linear mathematical models

More information

NEURAL NETWORK FUNDAMENTALS WITH GRAPHS, ALGORITHMS, AND APPLICATIONS

NEURAL NETWORK FUNDAMENTALS WITH GRAPHS, ALGORITHMS, AND APPLICATIONS NEURAL NETWORK FUNDAMENTALS WITH GRAPHS, ALGORITHMS, AND APPLICATIONS N. K. Bose HRB-Systems Professor of Electrical Engineering The Pennsylvania State University, University Park P. Liang Associate Professor

More information

Predictive Dynamix Inc

Predictive Dynamix Inc Predictive Modeling Technology Predictive modeling is concerned with analyzing patterns and trends in historical and operational data in order to transform data into actionable decisions. This is accomplished

More information

Grid e-services for Multi-Layer SOM Neural Network Simulation

Grid e-services for Multi-Layer SOM Neural Network Simulation Grid e-services for Multi-Layer SOM Neural Network Simulation,, Rui Silva Faculdade de Engenharia 4760-108 V. N. Famalicão, Portugal {rml,rsilva}@fam.ulusiada.pt 2007 Outline Overview Multi-Layer SOM Background

More information

Principles of training multi-layer neural network using backpropagation algorithm

Principles of training multi-layer neural network using backpropagation algorithm Page 1 Students' Project: "Neural networks and artificial inteligence in electronics" Teacher: mgr inż. Adam Gołda Authors: Mariusz Bernacki Przemysław Włodarczyk Electronics V ( 2005) Principles of training

More information

Building MLP networks by construction

Building MLP networks by construction University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2000 Building MLP networks by construction Ah Chung Tsoi University of

More information

Planning Sheet: Terrific Toys for Tiny Tots!! CURRICULUM INTENTION

Planning Sheet: Terrific Toys for Tiny Tots!! CURRICULUM INTENTION Planning Sheet: Terrific Toys for Tiny Tots!! CURRICULUM INTENTION Maths Level Statements Level 2 Data: Students collect and organise data, create and interpret a range of data displays and identify significant

More information

MOSFET DIFFERENTIAL AMPLIFIER (TWO-WEEK LAB)

MOSFET DIFFERENTIAL AMPLIFIER (TWO-WEEK LAB) page 1 of 7 MOSFET DIFFERENTIAL AMPLIFIER (TWO-WEEK LAB) BACKGROUND The MOSFET is by far the most widely used transistor in both digital and analog circuits, and it is the backbone of modern electronics.

More information

The Research of Data Mining Based on Neural Networks

The Research of Data Mining Based on Neural Networks 2011 International Conference on Computer Science and Information Technology (ICCSIT 2011) IPCSIT vol. 51 (2012) (2012) IACSIT Press, Singapore DOI: 10.7763/IPCSIT.2012.V51.09 The Research of Data Mining

More information

A Survey of Kernel Clustering Methods

A Survey of Kernel Clustering Methods A Survey of Kernel Clustering Methods Maurizio Filippone, Francesco Camastra, Francesco Masulli and Stefano Rovetta Presented by: Kedar Grama Outline Unsupervised Learning and Clustering Types of clustering

More information

Lecture 14: Section 3.3

Lecture 14: Section 3.3 Lecture 14: Section 3.3 Shuanglin Shao October 23, 2013 Definition. Two nonzero vectors u and v in R n are said to be orthogonal (or perpendicular) if u v = 0. We will also agree that the zero vector in

More information

The Result Analysis of the Cluster Methods by the Classification of Municipalities

The Result Analysis of the Cluster Methods by the Classification of Municipalities The Result Analysis of the Cluster Methods by the Classification of Municipalities PAVEL PETR, KAŠPAROVÁ MILOSLAVA System Engineering and Informatics Institute Faculty of Economics and Administration University

More information

SEQUENCES ARITHMETIC SEQUENCES. Examples

SEQUENCES ARITHMETIC SEQUENCES. Examples SEQUENCES ARITHMETIC SEQUENCES An ordered list of numbers such as: 4, 9, 6, 25, 36 is a sequence. Each number in the sequence is a term. Usually variables with subscripts are used to label terms. For example,

More information

Logic Design. Implementation Technology

Logic Design. Implementation Technology Logic Design Implementation Technology Outline Implementation of logic gates using transistors Programmable logic devices Complex Programmable Logic Devices (CPLD) Field Programmable Gate Arrays (FPGA)

More information

ALG 1A Algebra I, First Semester PR-10254, BK (v.3.0) To the Student:

ALG 1A Algebra I, First Semester PR-10254, BK (v.3.0) To the Student: ALG 1A Algebra I, First Semester PR-10254, BK-10255 (v.3.0) To the Student: After your registration is complete and your proctor has been approved, you may take the Credit by Examination for ALG 1A. WHAT

More information

is in plane V. However, it may be more convenient to introduce a plane coordinate system in V.

is in plane V. However, it may be more convenient to introduce a plane coordinate system in V. .4 COORDINATES EXAMPLE Let V be the plane in R with equation x +2x 2 +x 0, a two-dimensional subspace of R. We can describe a vector in this plane by its spatial (D)coordinates; for example, vector x 5

More information

Visualization of Topology Representing Networks

Visualization of Topology Representing Networks Visualization of Topology Representing Networks Agnes Vathy-Fogarassy 1, Agnes Werner-Stark 1, Balazs Gal 1 and Janos Abonyi 2 1 University of Pannonia, Department of Mathematics and Computing, P.O.Box

More information

MANAGING QUEUE STABILITY USING ART2 IN ACTIVE QUEUE MANAGEMENT FOR CONGESTION CONTROL

MANAGING QUEUE STABILITY USING ART2 IN ACTIVE QUEUE MANAGEMENT FOR CONGESTION CONTROL MANAGING QUEUE STABILITY USING ART2 IN ACTIVE QUEUE MANAGEMENT FOR CONGESTION CONTROL G. Maria Priscilla 1 and C. P. Sumathi 2 1 S.N.R. Sons College (Autonomous), Coimbatore, India 2 SDNB Vaishnav College

More information

Recurrent Neural Networks

Recurrent Neural Networks Recurrent Neural Networks Neural Computation : Lecture 12 John A. Bullinaria, 2015 1. Recurrent Neural Network Architectures 2. State Space Models and Dynamical Systems 3. Backpropagation Through Time

More information

SOFTWARE EFFORT ESTIMATION USING RADIAL BASIS FUNCTION NEURAL NETWORKS Ana Maria Bautista, Angel Castellanos, Tomas San Feliu

SOFTWARE EFFORT ESTIMATION USING RADIAL BASIS FUNCTION NEURAL NETWORKS Ana Maria Bautista, Angel Castellanos, Tomas San Feliu International Journal Information Theories and Applications, Vol. 21, Number 4, 2014 319 SOFTWARE EFFORT ESTIMATION USING RADIAL BASIS FUNCTION NEURAL NETWORKS Ana Maria Bautista, Angel Castellanos, Tomas

More information

GRAPHING (2 weeks) Main Underlying Questions: 1. How do you graph points?

GRAPHING (2 weeks) Main Underlying Questions: 1. How do you graph points? GRAPHING (2 weeks) The Rectangular Coordinate System 1. Plot ordered pairs of numbers on the rectangular coordinate system 2. Graph paired data to create a scatter diagram 1. How do you graph points? 2.

More information

Forecasting Trade Direction and Size of Future Contracts Using Deep Belief Network

Forecasting Trade Direction and Size of Future Contracts Using Deep Belief Network Forecasting Trade Direction and Size of Future Contracts Using Deep Belief Network Anthony Lai (aslai), MK Li (lilemon), Foon Wang Pong (ppong) Abstract Algorithmic trading, high frequency trading (HFT)

More information

Handling of incomplete data sets using ICA and SOM in data mining

Handling of incomplete data sets using ICA and SOM in data mining Neural Comput & Applic (2007) 16: 167 172 DOI 10.1007/s00521-006-0058-6 ORIGINAL ARTICLE Hongyi Peng Æ Siming Zhu Handling of incomplete data sets using ICA and SOM in data mining Received: 2 September

More information

10.4 APPLICATIONS OF NUMERICAL METHODS Applications of Gaussian Elimination with Pivoting

10.4 APPLICATIONS OF NUMERICAL METHODS Applications of Gaussian Elimination with Pivoting 558 HAPTER NUMERIAL METHODS 5. (a) ompute the eigenvalues of A 5. (b) Apply four iterations of the power method with scaling to each matrix in part (a), starting with x,. 5. (c) ompute the ratios for A

More information

Neural Nets. General Model Building

Neural Nets. General Model Building Neural Nets To give you an idea of how new this material is, let s do a little history lesson. The origins are typically dated back to the early 1940 s and work by two physiologists, McCulloch and Pitts.

More information

Design call center management system of e-commerce based on BP neural network and multifractal

Design call center management system of e-commerce based on BP neural network and multifractal Available online www.jocpr.com Journal of Chemical and Pharmaceutical Research, 2014, 6(6):951-956 Research Article ISSN : 0975-7384 CODEN(USA) : JCPRC5 Design call center management system of e-commerce

More information

Fraudulent Behavior Forecast in Telecom Industry Based on Data Mining Technology

Fraudulent Behavior Forecast in Telecom Industry Based on Data Mining Technology Communications of the IIMA Volume 7 Issue 4 Article 1 2007 Fraudulent Behavior Forecast in Telecom Industry Based on Data Mining Technology Sen Wu School of Economics and Management University of Science

More information

USING SELF-ORGANIZING MAPS FOR INFORMATION VISUALIZATION AND KNOWLEDGE DISCOVERY IN COMPLEX GEOSPATIAL DATASETS

USING SELF-ORGANIZING MAPS FOR INFORMATION VISUALIZATION AND KNOWLEDGE DISCOVERY IN COMPLEX GEOSPATIAL DATASETS USING SELF-ORGANIZING MAPS FOR INFORMATION VISUALIZATION AND KNOWLEDGE DISCOVERY IN COMPLEX GEOSPATIAL DATASETS Koua, E.L. International Institute for Geo-Information Science and Earth Observation (ITC).

More information

Java Modules for Time Series Analysis

Java Modules for Time Series Analysis Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series

More information

Introduction to Artificial Neural Networks. Introduction to Artificial Neural Networks

Introduction to Artificial Neural Networks. Introduction to Artificial Neural Networks Introduction to Artificial Neural Networks v.3 August Michel Verleysen Introduction - Introduction to Artificial Neural Networks p Why ANNs? p Biological inspiration p Some examples of problems p Historical

More information

Quadratic Equations and Inequalities

Quadratic Equations and Inequalities MA 134 Lecture Notes August 20, 2012 Introduction The purpose of this lecture is to... Introduction The purpose of this lecture is to... Learn about different types of equations Introduction The purpose

More information

The Gradient and Level Sets

The Gradient and Level Sets The Gradient and Level Sets. Let f(x, y) = x + y. (a) Find the gradient f. Solution. f(x, y) = x, y. (b) Pick your favorite positive number k, and let C be the curve f(x, y) = k. Draw the curve on the

More information

The data set we have taken is about calculating body fat percentage for an individual.

The data set we have taken is about calculating body fat percentage for an individual. The Process we are mining: The data set we have taken is about calculating body fat percentage for an individual. What is Body Fat percentage? The body fat percentage (BFP) of a human or other living being

More information

THREE DIMENSIONAL REPRESENTATION OF AMINO ACID CHARAC- TERISTICS

THREE DIMENSIONAL REPRESENTATION OF AMINO ACID CHARAC- TERISTICS THREE DIMENSIONAL REPRESENTATION OF AMINO ACID CHARAC- TERISTICS O.U. Sezerman 1, R. Islamaj 2, E. Alpaydin 2 1 Laborotory of Computational Biology, Sabancı University, Istanbul, Turkey. 2 Computer Engineering

More information

Using chaotic artificial neural networks to model memory in the brain. 1. Introduction

Using chaotic artificial neural networks to model memory in the brain. 1. Introduction Using chaotic artificial neural networks to model memory in the brain Zainab Aram a, Sajad Jafari a,*, Jun Ma b, J. C. Sprott c a Biomedical Engineering Department, Amirkabir University of Technology,

More information

NEURAL NETWORKS A Comprehensive Foundation

NEURAL NETWORKS A Comprehensive Foundation NEURAL NETWORKS A Comprehensive Foundation Second Edition Simon Haykin McMaster University Hamilton, Ontario, Canada Prentice Hall Prentice Hall Upper Saddle River; New Jersey 07458 Preface xii Acknowledgments

More information

Feed-Forward mapping networks KAIST 바이오및뇌공학과 정재승

Feed-Forward mapping networks KAIST 바이오및뇌공학과 정재승 Feed-Forward mapping networks KAIST 바이오및뇌공학과 정재승 How much energy do we need for brain functions? Information processing: Trade-off between energy consumption and wiring cost Trade-off between energy consumption

More information

Data Mining using Rule Extraction from Kohonen Self-Organising Maps

Data Mining using Rule Extraction from Kohonen Self-Organising Maps Data Mining using Rule Extraction from Kohonen Self-Organising Maps James Malone, Kenneth McGarry, Stefan Wermter and Chris Bowerman School of Computing and Technology, University of Sunderland, St Peters

More information

Essential Question: What is the relationship among the focus, directrix, and vertex of a parabola?

Essential Question: What is the relationship among the focus, directrix, and vertex of a parabola? Name Period Date: Topic: 9-3 Parabolas Essential Question: What is the relationship among the focus, directrix, and vertex of a parabola? Standard: G-GPE.2 Objective: Derive the equation of a parabola

More information

Neural Network Add-in

Neural Network Add-in Neural Network Add-in Version 1.5 Software User s Guide Contents Overview... 2 Getting Started... 2 Working with Datasets... 2 Open a Dataset... 3 Save a Dataset... 3 Data Pre-processing... 3 Lagging...

More information

Factor Analysis. Chapter 420. Introduction

Factor Analysis. Chapter 420. Introduction Chapter 420 Introduction (FA) is an exploratory technique applied to a set of observed variables that seeks to find underlying factors (subsets of variables) from which the observed variables were generated.

More information

Methods of comparative plotting of the ship s position

Methods of comparative plotting of the ship s position Methods of comparative plotting of the ship s position A. Stateczny The Institute of Marine TraJ5c Engineering, Maritime Universi~ Szczecin, Poland. Abstract In recent years the problem of position plotting

More information

Module 4 : Propagation Delays in MOS Lecture 22 : Logical Effort Calculation of few Basic Logic Circuits

Module 4 : Propagation Delays in MOS Lecture 22 : Logical Effort Calculation of few Basic Logic Circuits Module 4 : Propagation Delays in MOS Lecture 22 : Logical Effort Calculation of few Basic Logic Circuits Objectives In this lecture you will learn the following Introduction Logical Effort of an Inverter

More information

Lab 1. The Fourier Transform

Lab 1. The Fourier Transform Lab 1. The Fourier Transform Introduction In the Communication Labs you will be given the opportunity to apply the theory learned in Communication Systems. Since this is your first time to work in the

More information

a) Determine the equation for v(t), including numerical values for all constants.

a) Determine the equation for v(t), including numerical values for all constants. a) Determine the equation for v(t), including numerical values for all constants. 1 pt for correct trig eqn with ( ) sign 1 pt. for using eqn. to solve for omega 1 pt for correct period of 0.70 s 1 pt

More information

Chapter 7. Diagnosis and Prognosis of Breast Cancer using Histopathological Data

Chapter 7. Diagnosis and Prognosis of Breast Cancer using Histopathological Data Chapter 7 Diagnosis and Prognosis of Breast Cancer using Histopathological Data In the previous chapter, a method for classification of mammograms using wavelet analysis and adaptive neuro-fuzzy inference

More information