Grid e-services for Multi-Layer SOM Neural Network Simulation



Similar documents
A Secure Intrusion detection system against DDOS attack in Wireless Mobile Ad-hoc Network Abstract

Credit Card Fraud Detection Using Self Organised Map

Computing in High- Energy-Physics: How Virtualization meets the Grid

Intrusion Detection for Grid and Cloud Computing

ultra fast SOM using CUDA

Data centre virtualization at UTAD A hybrid consolidation aproach

Online Steering of HEP Applications

Presenting Mongoose A New Approach to Traffic Capture (patent pending) presented by Ron McLeod and Ashraf Abu Sharekh January 2013

UNIVERSITY OF BOLTON SCHOOL OF ENGINEERING MS SYSTEMS ENGINEERING AND ENGINEERING MANAGEMENT SEMESTER 1 EXAMINATION 2015/2016 INTELLIGENT SYSTEMS

Peer-to-peer cooperative scheduling architecture for National Grid Infrastructure

The RMOST Online Steering Tool

Scheduling and Resource Management in Computational Mini-Grids

Windows Server 2008 R2 Essentials

Training a Self-Organizing distributed on a PVM network

PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN

COMPUTATIONIMPROVEMENTOFSTOCKMARKETDECISIONMAKING MODELTHROUGHTHEAPPLICATIONOFGRID. Jovita Nenortaitė

DATA SECURITY BASED ON NEURAL NETWORKS

Neural network software tool development: exploring programming language options

IMPLEMENTING GREEN IT

Data Mining and Neural Networks in Stata

Doctor of Philosophy in Computer Science

Efficient Load Balancing using VM Migration by QEMU-KVM

OPTIMAL MULTI SERVER CONFIGURATION FOR PROFIT MAXIMIZATION IN CLOUD COMPUTING

SEE-GRID-SCI. SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul December, 2009

Classification of Engineering Consultancy Firms Using Self-Organizing Maps: A Scientific Approach

Indexing Full Packet Capture Data With Flow

GraySort and MinuteSort at Yahoo on Hadoop 0.23

Neural Network Add-in

Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations

Research of Railway Wagon Flow Forecast System Based on Hadoop-Hazelcast

Cluster, Grid, Cloud Concepts

Tableau Server 7.0 scalability

PORTUGAL: Total EC Funding: 86M (1.4% of total) Total number of participations: 247 (1.7% of total) Number of project co-ordinations: 17

Uptime Infrastructure Monitor. Installation Guide

Tackling Big Data with MATLAB Adam Filion Application Engineer MathWorks, Inc.

Sla Aware Load Balancing Algorithm Using Join-Idle Queue for Virtual Machines in Cloud Computing

MANAGING QUEUE STABILITY USING ART2 IN ACTIVE QUEUE MANAGEMENT FOR CONGESTION CONTROL

Artificial Intelligence and Machine Learning Models

Master of Science in Computer Science

Design call center management system of e-commerce based on BP neural network and multifractal

Windows Server 2008 Essentials. Installation, Deployment and Management

6.2.8 Neural networks for data mining

Innovative, High-Density, Massively Scalable Packet Capture and Cyber Analytics Cluster for Enterprise Customers

A Uniform Job Monitoring Service in Multiple Job Universes

ANN Based Fault Classifier and Fault Locator for Double Circuit Transmission Line

Integrating a heterogeneous and shared Linux cluster into grids

Rodrigo Fernandes de Mello, Evgueni Dodonov, José Augusto Andrade Filho

Parallel Computing with Mathematica UVACSE Short Course

Mining Association Rules on Grid Platforms

Energy-aware job scheduler for highperformance

Planning the Installation and Installing SQL Server

Open source integrated remote systems and network management with OpenRSM. M. Kalochristianakis E. Varvarigos

Table of Contents Introduction and System Requirements 9 Installing VMware Server 35

Self Organizing Maps: Fundamentals

Load balancing in a heterogeneous computer system by self-organizing Kohonen network

GEDDM - Commercial Data Mining Using Distributed Resources

Energy and commodity price benchmarking and market insights

CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms

Vormetric and SanDisk : Encryption-at-Rest for Active Data Sets

Cloud Computing Where ISR Data Will Go for Exploitation

NETWRIX EVENT LOG MANAGER

Figure 1. The cloud scales: Amazon EC2 growth [2].

Efficient Parallel Execution of Sequence Similarity Analysis Via Dynamic Load Balancing

CMS Tier-3 cluster at NISER. Dr. Tania Moulik

Mobile Phone APP Software Browsing Behavior using Clustering Analysis

System Requirements for Microsoft Dynamics SL 2015

Bringing Big Data Modelling into the Hands of Domain Experts

A New Approach For Estimating Software Effort Using RBFN Network

Portugal: ICT R&D and participation to FP7

Committing Science to Global Development Award for Best Science Paper

XIV. Title. 2.1 Schematics of the WEP Encryption in WEP technique Decryption in WEP technique Process of TKIP 25

Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle

Method of Combining the Degrees of Similarity in Handwritten Signature Authentication Using Neural Networks

A Comparison of Oracle Performance on Physical and VMware Servers

Phire Architect Hardware and Software Requirements

Next Generation Intrusion Detection: Autonomous Reinforcement Learning of Network Attacks

Europass Curriculum Vitae

Intrusion Detection. Jeffrey J.P. Tsai. Imperial College Press. A Machine Learning Approach. Zhenwei Yu. University of Illinois, Chicago, USA

Using Emulation Techniques to Speed up the Convergence between Mobile Communications and Cloud Computing

Large Data Visualization using Shared Distributed Resources

Application of Predictive Analytics for Better Alignment of Business and IT

Chapter 12 Discovering New Knowledge Data Mining

Portugal. Sub-Programme / Key Activity. HOSPITAL GARCIA DE ORTA PAR 2007 ERASMUS Erasmus Network European Pathology Assessment & Learning System

About this Course This 5 day ILT course teaches IT Professionals to design and deploy Microsoft SharePoint 2010.

Designing and Embodiment of Software that Creates Middle Ware for Resource Management in Embedded System

Global Grid User Support - GGUS - in the LCG & EGEE environment

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

RenderStorm Cloud Render (Powered by Squidnet Software): Getting started.

1. Product Information

Online Backup Client User Manual Linux

Sun Grid Engine, a new scheduler for EGEE

Stream Processing on GPUs Using Distributed Multimedia Middleware

How To Get A Computer Engineering Degree

StruxureWare Data Center Expert Release Notes

Impelling Heart Attack Prediction System using Data Mining and Artificial Neural Network

This exam contains 13 pages (including this cover page) and 18 questions. Check to see if any pages are missing.

An Introduction to High Performance Computing in the Department

Online Steering in glite with RMOST. Daniel Lorenz University of Siegen Monitoring Workshop, Wuppertal

The Asterope compute cluster

Integration of Virtualized Worker Nodes in Standard-Batch-Systems CHEP 2009 Prague Oliver Oberst

Transcription:

Grid e-services for Multi-Layer SOM Neural Network Simulation,, Rui Silva Faculdade de Engenharia 4760-108 V. N. Famalicão, Portugal {rml,rsilva}@fam.ulusiada.pt 2007

Outline Overview Multi-Layer SOM Background Architecture and Design Local Implementation Grid Proposal Environment - GRIDSOM Conclusions Grid e-services for Multi-Layer SOM Neural Network Simulation 2

Overview Vila Nova de Famalicão ILID Instituto de Investigação e Desenvolvimento ( R&D Institute) 8 - R&D Centers (Lisboa, Porto, Famalicão) 1. Energy e Gestão Industrial (CLEGI) 2. Ciências Sociais e Humanas 3. Ciências Jurídicas 4. Arquitectura 5. Centro de Matemática 6. Centro de Recursos Humanos (CIDRHU) 7. Centro de Turismo, Inovação e Serviços (TIS) 8. Centro de Economia e Gestão Intelligent Tool Wear Monitoring http://www.fam.ulusiada.pt/ilid/mifc/index.htm Grid e-services for Multi-Layer SOM Neural Network Simulation 3

Intelligent Tool Wear Monitoring Cutting Process Wear monitoring Grid e-services for Multi-Layer SOM Neural Network Simulation 4

Our Problem Experiments were conducted on a CNC Non intrusive sensors Modeling technique based on artificial neural networks SOM Grid e-services for Multi-Layer SOM Neural Network Simulation 5

Multi-Layer SOM Background Clustering Method 1. Randomly initiate weights; 2. Present input vector; 3. Determine the distance between input feature vector and each output node; 4. Adjust weights according to winning frequency; 5. Select neuron with minimum distance to input feature vector; 6. Update weights; 7. Back to step 2. 7. Division of the output map into several sub-maps Grid e-services for Multi-Layer SOM Neural Network Simulation 6

Multi-Layer SOM Results 9.00 8.00 7.00 6.00 5.00 4.00 3.00 2.00 1.00 0.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 9.00 8.00 7.00 Contour plot - tool with VB B =0.05 mm 9.00 8.00 7.00 6.00 5.00 4.00 3.00 2.00 1.00 0.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 9.00 8.00 7.00 Contour plot - tool with VB B =0.17 mm The sub-maps are treated as jobs in the GRID computing environment 6.00 6.00 5.00 5.00 4.00 4.00 3.00 3.00 2.00 2.00 1.00 1.00 0.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 Contour plot - tool with VB B =0.21mm Contour plot - tool with VB B =0.31 mm Grid e-services for Multi-Layer SOM Neural Network Simulation 7

Our Aim A lightweight architecture to support the execution of neural networks simulation tasks across the Grid infrastructure. Security Authentication Encryption Model Design Build Simulation Monitor Results Grid e-services for Multi-Layer SOM Neural Network Simulation 8

Architecture and Design Local Resources: Architecture (processor type) P IV 2GHz Number of Nodes 15 Operating system SL (Linux( Linux) Memory per Node 512 MB Grid middleware glite Disk per node 80 GB Job Manager LCG Cluster Storage 1 TB Grid e-services for Multi-Layer SOM Neural Network Simulation 9

Architecture and Design Layer Model Grid e-services for Multi-Layer SOM Neural Network Simulation 10

Architecture and Design Grid e-services for Multi-Layer SOM Neural Network Simulation 11

Neural Network Agent Manage and control tasks. Distribution of work load. Control neural network learning and recognition. Interface the communication between neural network layers. Local Service Local Database Grid e-services for Multi-Layer SOM Neural Network Simulation 12

Monitor Agent Submit jobs that are waiting in the Database. Querying the Logging and Bookkeeping. Collect those that have already been successfully finished. Re-submit unfinished jobs. Update the database with the jobs states. Scheduling System Local Service Local Database Grid e-services for Multi-Layer SOM Neural Network Simulation 13

Hybrid Approach Network Agent Simulation Algorithm Database Store Results Monitor Looks for new Jobs in Database Launch Jobs to the GRID Collect Results of job execution Fast Application Migration to GRID Grid e-services for Multi-Layer SOM Neural Network Simulation 14

GRIDSOM Prototype WEB Registration http:// ://gridsom.fam.ulusiada.pt Grid e-services for Multi-Layer SOM Neural Network Simulation 15

GRIDSOM Start Simulation Grid e-services for Multi-Layer SOM Neural Network Simulation 16

Generate.JDL File Grid e-services for Multi-Layer SOM Neural Network Simulation 17

Tasks in Database Current Tasks In the Outbox The Neural Network Agent will queue the initial job of this task Grid e-services for Multi-Layer SOM Neural Network Simulation 18

Monitor Launch Jobs Grid e-services for Multi-Layer SOM Neural Network Simulation 19

Queued Jobs in Database Job status stored in (grid_status( grid_status) Grid e-services for Multi-Layer SOM Neural Network Simulation 20

Monitor Getting Job Status Job Done! But FAIL Job re-submit! Grid e-services for Multi-Layer SOM Neural Network Simulation 21

Monitor Getting Results Job Done! Neural Network Agent Generate a new iteration Until the Monitor Submit this new iteration: end of simulation Grid e-services for Multi-Layer SOM Neural Network Simulation 22

End Simulation Neural Network Agent Publish the final results. Grid e-services for Multi-Layer SOM Neural Network Simulation 23

User Collect Results Download de Final Data Grid e-services for Multi-Layer SOM Neural Network Simulation 24

Data Visualization Data Analysis (outside GRIDSOM) Grid e-services for Multi-Layer SOM Neural Network Simulation 25

Conclusions and Future Developments Prototype successfully tested Hybrid approach SSL layer Migrate to New Scheduling System Virtual Organization Core services Grid e-services for Multi-Layer SOM Neural Network Simulation 26

Many Thanks Grid e-services for Multi-Layer SOM Neural Network Simulation 27