The LOTAAS survey: progress report and new discoveries



Similar documents
Charting the Transient Radio Sky on Sub-Second Time-Scales with LOFAR

Ionospheric Research with the LOFAR Telescope

Main Memory Data Warehouses

The Solar Science Data Center and LOFAR

ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)

Purchase of High Performance Computing (HPC) Central Compute Resources by Northwestern Researchers

The Murchison Widefield Array Data Archive System. Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia

CORRIGENDUM TO TENDER FOR HIGH PERFORMANCE SERVER

High Performance. CAEA elearning Series. Jonathan G. Dudley, Ph.D. 06/09/ CAE Associates

SURFsara HPC Cloud Workshop

SURFsara HPC Cloud Workshop

Brainlab Node TM Technical Specifications

Uniboard based digital receiver

LOFAR DEEP FIELDS. CHALLENGES AND CLOUD SOLUTIONS.

Dragon Medical Enterprise Network Edition Technical Note: Requirements for DMENE Networks with virtual servers

Novinky v Oracle Exadata Database Machine

LOFAR Software Development Roadmap

IBM System x SAP HANA

An Affordable Commodity Network Attached Storage Solution for Biological Research Environments.

Future Generation Computer Systems

wu.cloud: Insights Gained from Operating a Private Cloud System

GPU System Architecture. Alan Gray EPCC The University of Edinburgh

High Performance Computing in CST STUDIO SUITE

Mississippi State University High Performance Computing Collaboratory Brief Overview. Trey Breckenridge Director, HPC

Estonian Scientific Computing Infrastructure (ETAIS)

EMC VMAX3 FAMILY - VMAX 100K, 200K, 400K

SMB Direct for SQL Server and Private Cloud

Sense Making in an IOT World: Sensor Data Analysis with Deep Learning

SUBJECT: SOLIDWORKS HARDWARE RECOMMENDATIONS UPDATE

GPU Renderfarm with Integrated Asset Management & Production System (AMPS)

IT of SPIM Data Storage and Compression. EMBO Course - August 27th! Jeff Oegema, Peter Steinbach, Oscar Gonzalez

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Lecture 1: the anatomy of a supercomputer

The Greenplum Analytics Workbench

FPGA-Accelerated Heterogeneous Hyperscale Server Architecture for Next-Generation Compute Clusters

What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1

Data transport in radio astronomy. Arpad Szomoru, JIVE

CFD Implementation with In-Socket FPGA Accelerators

Autodesk Inventor on the Macintosh

LLamasoft K2 Enterprise 8.1 System Requirements

Microsoft Windows Server Update Services Questions & Answers About The Product

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

HP Workstations for Adobe Creative Cloud

Parallel Programming Survey

Universal Form-factor. Wi Fi Troubleshooting Made Easy

HPC-related R&D in 863 Program


REQUIREMENTS TRACEABILITY

Parallel Large-Scale Visualization

HP ProLiant BL660c Gen9 and Microsoft SQL Server 2014 technical brief

TREND MICRO SOFTWARE APPLIANCE SUPPORT

Avigilon Control Center 5 System Integration Guide. for Software House C Cure 9000

LOFAR. The Low-Frequency Array. (tri-talk franglais)

Overview: X5 Generation Database Machines

Performance test report

Big Data Performance Growth on the Rise

Cornell University Center for Advanced Computing

HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect

HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK

Stream Processing on GPUs Using Distributed Multimedia Middleware

Investigation of storage options for scientific computing on Grid and Cloud facilities

Overview of HPC systems and software available within

Autodesk 3ds Max 2010 Boot Camp FAQ

HPC Cloud. Focus on your research. Floris Sluiter Project leader SARA

D-Link Central WiFiManager Configuration Guide

How Cineca supports IT

SEEK - Pulsar Search Software

Merge CADstream. For IT Professionals. Merge CADstream,

EMC VMAX3 FAMILY VMAX 100K, 200K, 400K

Business white paper. HP Process Automation. Version 7.0. Server performance

Chapter 6. Inside the System Unit. What You Will Learn... Computers Are Your Future. What You Will Learn... Describing Hardware Performance

COMP/CS 605: Intro to Parallel Computing Lecture 01: Parallel Computing Overview (Part 1)

White Paper. Recording Server Virtualization

Cluster Computing at HRI

Scientific Computing Data Management Visions

CONSTRUCTION / SERVICE BILLING SYSTEM SPECIFICATIONS

Michael Kagan.

EMC ISILON NL-SERIES. Specifications. EMC Isilon NL400. EMC Isilon NL410 ARCHITECTURE

1 DCSC/AU: HUGE. DeIC Sekretariat /RB. Bilag 1. DeIC (DCSC) Scientific Computing Installations

Transcription:

LOFAR Science Workshop, The Netherlands, 2016 1/21 The LOTAAS survey: progress report and new discoveries Sotiris Sanidas on behalf of: LOFAR Pulsar WG Anton Pannekoek Institute for Astronomy, University of Amsterdam April 5, 2016

LOFAR Science Workshop, The Netherlands, 2016 2/21 LOFAR Pulsar Working Group Jason Hessels (co-lead) Ben Stappers (co-lead) Cees Bassa Anya Bilous Rene Breton Thijs Coenen Sally Cooper Heino Falcke Marisa Geyer Jean-Mathias Griessmeier Daniele Michilli Aris Karastergiou Evan Keane Vlad Kondratiev Michael Kramer Joeri van Leeuwen Aris Noutsos Stefan Osłowski Maura Pilia Ziggy Pleunis Nataliya Porayko Sotiris Sanidas Maciej Serylak Charlotte Sobey Chia Min Tan Sander ter Veen Joris Verbiest Patrick Weltevrede Kimon Zagkouris ASTRON/Universiteit van Amsterdam University of Manchester ASTRON Universiteit van Amsterdam University of Manchester Universiteit van Amsterdam University of Manchester Radboud Universiteit Nijmegen University of Oxford LPC2E/CNRS/Universite d Orleans ASTRON/Universiteit van Amsterdam University of Oxford SKA HQ ASTRON MPIfR/University of Manchester ASTRON/Universiteit van Amsterdam MPIfR Universität Bielefeld INAF/Osservatorio Astronomico di Cagliari Universiteit van Amsterdam MPIfR Universiteit van Amsterdam University of the Western Cape Curtin University/CASS University of Manchester ASTRON Universität Bielefeld University of Manchester University of Oxford

LOFAR Science Workshop, The Netherlands, 2016 3/21 The LOTAAS Survey LOFAR Tied Array All-sky Survey All-northern-sky survey for pulsars, RRATS, and fast transients High Sensitivity 12 HBA sub-stations of superterp 32MHz BW, 119 151MHz, 12kHz channels, S min 1mJy@135MHz 493µs sampling - sensitive to MSPs up to DM 50pccm 3 The most sensitive very-low-frequency pulsar survey ever performed Great Field-of-View 3 sub-array pointings (SAP)/incoherent beams (30 sq. deg.) 183 tied-array beams (61 per SAP) (9 sq. deg.) 12 tied-array beams free (targeting known sources within SAP) Unique dwell time 1-hr integrations - essential for transients/intermittent pulsars See Coenen et al. 2014 for more info

LOFAR Science Workshop, The Netherlands, 2016 4/21 Observing setup 222 beams per pointing! The first SKA-like pulsar survey Coherent beams x4 more sensitive than incoherent beams deeper search Data Rate: 35Gbps, 16TB/pointing (4TB by downsampling to 8-bit data)

LOFAR Science Workshop, The Netherlands, 2016 5/21 Sky Coverage 3 passes of 651 pointings each (1953 total) for full sky coverage with TABs 10 observations/week. Pass 1 (633 successful) completed! Total survey s raw data: 8PB

LOFAR Science Workshop, The Netherlands, 2016 6/21 Sky Coverage Already in Pass2. Observation rate: 260hrs/Cycle Long Term proposal successful: 1040hrs granted within Cycles 5-8

LOFAR Science Workshop, The Netherlands, 2016 7/21 Raw Data Processing CPU time requests: 1st proposal:10m CPU hours - used! 2nd proposal:25m CPU hours Raw data storage SARA LTA Raw data processing Cartesius (SURFSARA) 500 nodes (24-cores, 64GB RAM) 3 hours processing/beam/node DM range:0 500pccm 3 Single Pulse searches Millions of periodicity candidates: 20000 periodicity candidates per pointing 40 million candidates expected Machine Learning classifier: 500 candidates/pointing Lyon et al. 2016 arxiv:1603.05166

LOFAR Science Workshop, The Netherlands, 2016 8/21 Follow-up Observations Localization of periodicity/single pulse candidates Follow-up observations arranged immediately (Kondratiev / ter Veen) 15-30 min duration Full-core/superterp All discoveries/confirmations appear immediately on http://www.astron.nl/lotaas

LOFAR Science Workshop, The Netherlands, 2016 9/21 Observations/Processing status + future Higher time resolution - Hunting MSPs Reduce time sampling to 246µsec (or even 164µsec) thanks to CEP4 4/2-bit downsampling to maintain storage requirements Expand survey s coverage down to δ = 10 Up in time with observations (Sanidas): Backlog built up due to 2015 Cartesius failures cleaned! Significant streamlining of the pipeline (processing/data archiving) Attainable processing rate: > 5 pointings/day New Machine Learning classifier (Chia Min Tan): Search deeper into the already processed data see Chia Min Tan s talk tomorrow New single pulse pipeline (Michilli): Already in place - Reprocessing of all LOTAAS data products ongoing GPU version of the pipeline (Bassa / Kondratiev): Almost finished on DRAGNET - plans to use on Cartesius as well

LOTAAS discoveries 2015 LOFAR Science Meeting LOFAR Science Workshop, The Netherlands, 2016 10/21 10 new LOTAAS periodicity search discoveries (Cooper) 1 from targeted searches (Kondratiev) 2 RRATS (Michilli - Single Pulse Pipeline v.1.0) 2 from commissioning survey (LOTAS)

LOTAAS discoveries 30 new LOTAAS periodicity search discoveries (Cooper/Sanidas) 1 from targeted searches (Kondratiev) 1 RRATS (Michilli - Single Pulse Pipeline v.1.0) 2 from commissioning survey (LOTAS) New pulsars also added for timing with LOFAR Also timed with the Lovell (1.4 GHz, if detected) LOFAR Science Workshop, The Netherlands, 2016 11/21

LOFAR Science Workshop, The Netherlands, 2016 12/21 Interesting LOTAAS discoveries - J0301+20 Detected in the sp pipeline as RRAT Redetected in Pass2 from the periodicity search Initial discovery during Cartesius failure Benefits of LOTAAS observing strategy Every point in the sky is covered: 1)3x with incoherent beams 2)1x with coherent beams

LOFAR Science Workshop, The Netherlands, 2016 13/21 Interesting LOTAAS discoveries - J0810+37 Extreme nuller 4 follow-ups - no show Confirmed with the superterp Localised with the full core Long dwell time pays off!!!

LOFAR Science Workshop, The Netherlands, 2016 14/21 Interesting LOTAAS discoveries - J1726+34 Discovered in the incoherent beam 4 follow-ups to localise Initial detection in a sidelobe Correctly, J1722+34

LOFAR Science Workshop, The Netherlands, 2016 15/21 Interesting LOTAAS discoveries - J1342+65 Found in the follow-up of J1340+65 Search pipeline always performed on follow-ups as well 2 superterp follow-ups - no show Weak source Full-core follow-ups to be arranged

LOFAR Science Workshop, The Netherlands, 2016 16/21 Interesting LOTAAS discoveries - J1529+40 Unusual profile for slow pulsar Rather small DM P entirely from Shklovskii effect? Very small spin-down rate?

LOFAR Science Workshop, The Netherlands, 2016 17/21 DRAGNET Dynamic Radio Astronomy of Galactic Neutron Stars and Extragalactic Transients A significant extension to LOFAR s capabilities for pulsar/fast transients research (and not only...) Installed in July 2015 @CIT, right next to COBALT Initial aims Accelerate LOTAAS processing Expand/Improve LOTAAS survey Real time search for transients DRAGNET Team: Jason Hessels (PI, ERC Grant) Alexander van Amesfoort (Tech. Dev.) Cees Bassa (Sc. postdoc) Vlad Kondratiev (Sc. postdoc) Daniele Michilli (PhD) Ziggy Pleunis (MSc) Sotiris Sanidas (Sc. postdoc) Many thanks to: Mike Sipior Edwin Stuut Henk Jonkers Arjen Koers Hopko Meijering Teun Grit

LOFAR Science Workshop, The Netherlands, 2016 18/21 DRAGNET DRAGNET backend: 23 nodes 2x Intel Xeon E5-2630v3 (16 cores 2.4GHz) 4 Titan X consumer cards (12GB, 3072 cores, 7TFLOPS) 128GB DDR4 RAM 16TB disk space 1 batch processing node Overall GPU performance: 600TFLOPS Total storage:400tb Direct links to COBALT/LOFAR network: 54Gb Infiniband 6x10Gb Ethernet

LOFAR Science Workshop, The Netherlands, 2016 19/21 DRAGNET Observing Observing directly to DRAGNET already performed (manually) Incorporation of DRAGNET into the production observing system (MoM/Scheduler) within Cycle 6 Record LOTAAS observations directly on DRAGNET (sparing CEP4 time) Possibility for LOFAR filler time Recording data on DRAGNET commensally with other observations Take station raw data and perform custom beamforming in parallel with other observations Processing GPU version of LOTAAS pipeline almost ready for production runs. Acceleration searches on all LOTAAS observations - MSPs!

LOFAR Science Workshop, The Netherlands, 2016 20/21 DRAGNET DRAGNET related projects Fermi unidentified γ-ray sources search (PI:Pleunis) Targeted search for MSPs Observations + processing exclusively on DRAGNET Don t miss Ziggy Pleunis talk tomorrow for progress report and some very nice results! Shadowing of FRB121102 Arecibo observations (PI:Bassa) Proposal just submitted (Cycle 6) Simultaneous observations with the Arecibo on the repeating FRB (Spitler et al. 2016, Nature) Assess FRB detectability at very low frequencies Potentially LOFAR will make the first FRB detection at these frequencies

Conclusions LOTAAS: LOTAAS will be the deepest low-frequency pulsar survey ever performed 35 pulsars found so far. > 100 with current discovery rate Already the most successful very-low-frequencies pulsar survey since 1970 LOTAAS has the potential to be one of the most successful pulsar surveys at any observing frequency DRAGNET: Accelerate and improve LOTAAS searching Expand the observing capabilities of LOFAR Stay tuned at www.astron.nl/lotaas for new discoveries! LOFAR Science Workshop, The Netherlands, 2016 21/21