Parabon Frontier. Enterprise Computing Platform. Featuring Frontier CODE. Collaborative Online Development Environment

Transcription

2 Frontier Enterprise Computing Platform Frontier Enterprise Deployment Frontier Enterprise Computing Platform is a turn-key, commercial off-the-shelf (COTS) software solution that harnesses the aggregate computing capacity of existing enterprise resources from laptops to Linux clusters, as well as Windows and Mac OS X desktops and workstations to securely deliver a variety of on-demand enterprise computing services. Frontier Server Frontier Compute Engines

3 Corporate History Parabon Computation, Inc. Founded in 1999; privately held business in Reston, VA In 2000, launched the first commercial off-the-shelf (COTS) grid computing solution: the Frontier Grid Platform Today, Parabon's Frontier Enterprise Computing Platform provides secure management and even greater control over enterprise resources from laptops to mainframes In addition, offers a 24x7 online capacity market Customers include commercial, non-profit, academic, and public sector: federal civilian agencies, defense, and members of the U.S. intelligence community

4 History of Enterprise Computing 1973 Ethernet Computer Networking 1969: ARPAnet The Original Internet 1965: CTSS Shared Access to a Single Computer Microsoft Windows 1975: Altair & Cray-1 First Microcomputer and Supercomputer Frontier 4 Grid Software as a Service 1999 Parabon Founded 1994 Beowulf NASA Frontier 5 VM Management 2000 Frontier Launched 1993 Mosaic Browser 2008 Frontier Dashboard 1999 SETI@home 1998 Frontier Prototype Frontier CODE & WorkFlow 2007 Cloud Computing Emerges Apache Hadoop Data Files Collaborative Online Development Environment INPUT 1 01/01 Data INPUT 2 01/02 Data INPUT 3 01/03 Data INPUT 4 01/04 Data INPUT Z 12/31 Data Distributed File System

5 Frontier Platform Overview Frontier Server Frontier Enterprise Deployment The Frontier Server software manages the execution of grid jobs and instantiation of cloud services. A single instance of the Frontier Server can manage a grid of up to 1,000 nodes, and Frontier can be scaled across multiple servers to support grids of 10,000 computers or more. Frontier Compute Engines 80% - 95% of the capacity of most computers goes unused. The Frontier Compute Engine unobtrusively harnesses that excess computing capacity. "# $ Here we see the CPU utilization of a dual-core system running Frontier in idle-only mode. After a period of inactivity ", the Compute Engine begins working #. As soon as a higher priority event such as user activity is observed $, the engine instantly cedes control. Frontier Server Frontier Compute Engines

6 Frontier Platform Features Integrated VM Management Users can launch tasks inside custom virtual machines using the Engine's built-in hypervisor Built-In Hypervisor Fault-Tolerant Task Migration In the event that a resource becomes unavailable, the Frontier Grid Server automatically migrates those tasks to redundant or fail-over resources Programmatic Provisioning Frontier allows VM instances to be turned on and off automatically based on developerspecified heuristics and current system conditions, without operator intervention if ( hits_per_second > MAX_HIT_RATE && last_created_time < (time ) && is_after('17:00') && is_before('23:59') ) { launch_new_server( "linux-apache.ovf", "MyCloudApp.war% ); }" " else if ( hits_per_second < MIN_HIT_RATE && last_removed_time < (time ) ) { remove_server($servers[0]); }

7 Frontier Platform Features Advanced Security Controls Frontier manages restricted resources, enabling administrators to define Engine Groups that limit access only to authenticated and authorized users Robust Reporting Capability Frontier jobs can be monitored, peak and current capacity can be measured, and resource utilization can be managed, all through the Frontier Dashboard Frontier is the only commercial grid software deployed within the U.S. Department of Defense and Intelligence Community

8 Frontier with Apache Hadoop By combining the Hadoop DFS with Frontier, Parabon enabled a US Government customer to ingest large amounts of public source data, process it with MapReduce, and create predictive models of future events based on historical patterns. Data Files INPUT 1 With Hadoop DFS, Frontier provides general-purpose computation across massive amounts of data. Data-Aware Scheduling pushes the work to the appropriate files, not the other way around, reducing network congestion, and Direct HDFS Access allows tasks to fetch remote data directly from a Hadoop DFS, rather than uploading elements at job launch. 01/01 Data INPUT 2 01/02 Data INPUT 3 01/03 Data INPUT 4 01/04 Data INPUT Z 12/31 Data Distributed File System MapReduce Application Map Reduce A-F T-Z query" MapReduce enables developers to quickly and easily execute simple processing operations (indexing, querying, etc.) in parallel against independent datasets. Map (Extract / Transform) Partition (Split / Load) Reduce (Aggregate / Query) INPUT 1 (key1: val1) (key2: val2) key1 (val1, val5, ) key1 (val1, val5, ) INPUT 2 (key3: val3) (key4: val4) key2 (val2, val8, ) key2 (val2, val8, ) INPUT 3 (key1: val5) (key4: val6) key3 (val3, val7, ) key3 (val3, val7, ) INPUT 4 (key1: val5) (key4: val6) key4 (val4, val6, ) key4 (val4, val6, ) INPUT Z (keyn: valx) (keym: valy) keyn (valx, valy, ) keyn (valx, valy, )

9 Frontier Enterprise Platform Deployment Frontier Enterprise Frontier Enterprise Scenario 1: Single Frontier Server in DMZ Scenario 2: Multiple Frontier Servers

10 Frontier Developer Tools Frontier-Enable Legacy Apps Frontier Rapids : A powerful Integration & Execution Environment allows developers to package and distribute existing applications across Frontier without having to edit any source code Write & Run Your Own Frontier Applications Frontier includes a rich suite of developer tools that provides everything developers need to write and run new Frontier applications: Frontier SDK: A collection of software tools that enable developers to write, monitor, and control the execution of apps on Frontier. Frontier IDE for Eclipse : An Eclipse plug-in that allows developers to load and launch Frontier applications, leverage code completion, and directly access the Frontier SDK documentation while editing their applications source code. Origin Evolutionary SDK: A framework of Evolutionary Computation (EC) algorithms designed to run on Frontier for performing optimization with existing models or simulations. Frontier JumpStart : An Application Generator that enables developers to write and run their own Frontier Dashboard applications in less than 10 MINUTES

11 Frontier CODE Dev Environment Frontier CODE Collaborative Online Development Environment The new Frontier CODE development environment provides browser-based Platform as a Service (PaaS) tools for creating vibrant code-centric communities around cloud- and grid-based software applications.

12 Frontier CODE Features Integrated Code Editor Frontier CODE includes the ACE (formerly Bespin) in-browser editor, allowing Domain Programmers to modify source code directly in their browsers, making it easier for scientists and researchers to develop custom models without having to create the supporting infrastructure as well. Collaborative Tools Frontier CODE allows project administrators to stand up their own custom Drupal-powered content management systems (CMS), which may include a wiki (shared document system), forums, issue trackers, and a number of other third-party modules. In addition to the hosted Drupal CMS, project administrators may provide URLs to existing documentation on their own intranet, as well. Version Control Frontier CODE offers a hosted SVN repository for centralized source code management and version control. Additionally, Frontier CODE can use other SCM systems e.g., git for distributed version control.

13 Frontier CODE Community Core Application Developer Core Application Developer Leverages Toolkits - Frontier SDK, JumpStart - Eclipse IDE, JavaDocs - Source Repositories Core Application Developer - CVS, SVN, Git, etc. Manages Compiler VM(s) Leverages Toolkits - Creates VMware Image(s) - Frontier SDK, JumpStart, Eclipse IDE, JavaDocs - Standard Compiler(s) - Source Repositories: CVS, SVN, Git, etc. - Standard OS(es) Manages Compiler VM(s) - Standard Compilers, Linkers, Toolchains - Standard OS(es) Domain Programmer Tweaks Science/Business Application Logic Programs in Fortran, R, Scheme, etc. Uses Integrated Text Editor Creates Branches and/or Variants Builds against Standard Compile VMs Collaborates via Forums and/or Wikis Domain Programmer QA Tester QA Tester Runs Applications and Various Logic Modules against Standard QA Environment(s) - Selects VM(s) for Compile (Build) Time - Selects VM(s) for Execution (Run) Time - Automates Unit Testing End User - Selects Application(s) and Provides Input Data - Launches Jobs and Analyzes Results Doesn't have to touch code Doesn't have to worry about OS configuration It Just Works" End User

14 Frontier Enterprise Computing Platform SAVE MONEY Maximize ROI of enterprise assets Reuse existing computing resources and reduce future hardware expenditure SAVE TIME Speed data-heavy and cpu-intensive applications from months to minutes DO MORE From distributed command & control to programmatic provisioning of virtual cloud services AND MORE

15 Frontier Enterprise Computing Platform Frontier increases efficiency in many domains. How can Frontier help you? Assembly Planning Biodefense Bioinformatics Biometrics (multi-modal) Capacity Planning Climate Modeling Cloud Services Combinatorial Optimization Cybersecurity Simulation Data Fusion Data Mining Decision Support Decryption Distributed Denial of Service (DDoS) Testing Distributed Storage Drug Discovery Environmental Modeling Evolutionary Optimization Extract, Transform & Load (ETL) Financial Forecasting Genomic Sequencing Intelligence, Surveillance & Reconnaissance (ISR) Load Balancing Load & Performance Testing Logistical Planning Machine Learning Modeling & Simulation Molecular Modeling Monte Carlo Simulations Nanotechnology Network Monitoring & Analysis Oil & Gas Exploration Operations Research Optimization Parameter Studies Photorealistic Rendering Predictive Analytics Proteomics Psychometric Profiling Robotic Motion Planning Sensitivity Analysis Search Sensor Placement Optimization Statistical Analysis Steganography Weather Prediction and many more