Big Data Analytics for Upstream Geoscience
|
|
- Chester Welch
- 8 years ago
- Views:
Transcription
1 Big Data Analytics for Upstream Geoscience Sunjay 1, Manas Banerjee 2 and Gaurav Kumar Dwivedi 3 1 Dept. of Geophysics, BHU,India 2 Dept. of Geophysics, BHU,India 3 Dept. of Geophysics, BHU,India Corresponding sunjay.sunjay@gmail.com Abstract Analytics is the discovery and communication of meaningful patterns in data. Analytics often favours data visualisation to communicate insight. Big data analytics is the use of advanced analytic techniques against very large, diverse data sets that include different types such as structured & unstructured and streaming & batch, and different sizes from terabytes, petabytes, exabytes to zettabytes. Big data can be described by the following characteristics: Volume,Variety,Velocity,Variability,Veracity,Complexity. Oil and Gas Big Data with Analytics provides a complete view of upstream geoscience oil and gas industry. The acute need for optimization in the oil and gas exploration and production stages and shows how data analytics can provide such optimization with span of exploration, development, production and rejuvenation of oil and gas assets. Statistical Analysis System SAS big data analytics software to boost exploration and production. Use big data analytics to efficiently drive oil and gas exploration and production. The oil and gas industry has an opportunity to capitalize on big data analytics solutions. Big Data and microseismic imaging will accelerate the smart drilling oil and gas revolution. Seismic data processing,imaging and interpretations,modelling and simulation are integral part of subsurface deciphering with high performance computing. The Geoillustrator & interpreters focus on illustrative geology for subsurface precise imaging. During the project we will develop new and better ways to digitally model and illustrate geological data and geological concepts. By using state of the art computer graphics and interaction hardware, Geoillustrator contributes novel ideas to the science field of visualization and computer graphics. Seismic Volume Visualization for Horizon Extraction, Rapid Visualization of Geological Concepts, illustrative 3D visualization of seismic data, Flowbased segmentation of seismic data, Geoillustrator Visualisation of Rock by Graphics Processing Unit(GPU), etc. Seismic Hadoop combines Seismic Unix with Cloudera s distribution including Apache Hadoop to make it easy to execute common seismic data processing tasks on a Hadoop(Pig) cluster. Keywords: Big Data Analytics,Seismic Unix,,Hadoop Cluster, seismic imaging Introduction Big Data In The Oil & Gas Upstream Sector : Upstream is no stranger to Big Data. Oil & Gas companies use thousands of sensors installed in subsurface wells and surface facilities to provide continuous data-collecting, real-time monitoring of assets and environmental conditions (Brulé, 2013). The data volume is coming from sensors, spatial and GPS coordinates, weather services, seismic data, and various measuring devices. Structured data is handled with specific applications used to manage surveying, processing and imaging, exploration planning, reservoir modeling, production, and other upstream activities. But much of this data is unstructured or semi-structured such as s, word processing documents, spreadsheets, images, voice recordings, multimedia, and data market feeds, which means it s difficult or costly to either store in traditional data warehouses or routinely query and analyze. In this case, appropriate tools for Big Data should be used (Hems & al., 2013). To support the real-time decision-making, Oil & Gas companies need tools that integrate and synthesize diverse data sources into a unified whole. Being able to process Big Data makes it possible to derive insight from the relationships that will surface when all of these sources are processed as a whole. But to unlock this value, Oil & Gas companies need
2 access to the appropriate technology, tools, and expertise. Like generic Big Data, the Upstream Data is also characterized by the 6V: Volume: Seismic data acquisition: Wide azimuth offshore seismic data acquisition ; Seismic processing Variety: Structured: standard and data models such PPDM, SEG-Y, WITSML, PRODML, RESML, etc. ; Unstructured: images, log curves, well log, maps, audio, video, etc. ; Semi-structured: processed data such analysis, interpretations, daily drilling reports, etc. Velocity: Real-time streaming data from wellheads, drilling equipment (EDR, LWD, MWD, Mud Logging...) and sensors (Flow, Pressure, ROP, Veracity (Data Quality): Improve data quality ; Run integrated asset models ; Combination of seismic, drilling and production data ; Drive innovation with unconventional resources (shale gas, tight oil) ; Pre-processing to identify data anomalies Variability:Seismic Interpretation,reservoir simulation,data interpolation(sparse signal) Value: Increase speed to first oil ; Enhancing production ; Reduce costs, such as Non Productive Time (NPT); Reduce risks, especially in the areas of Helth, Safety and Environment Theory Exploration And Development -By combination of Big Data and advanced analytics in Exploration and Development activities, managers and experts can perform strategic and operational decision-making. The areas where the analytics tools associated with Big Data can benefit Oil & Gas exploration include: Enhancing exploration efforts: Historical drilling and production data help geologists and geophysicists verify their assumptions in their analysis of a field where environmental regulations restrict new surveys (Feblowitz, 2012). Combine enterprise data with real-time production data to deliver new insights to operating teams for enhancing exploration efforts (Hems & al, 2013). Assessing new prospects: Create competitive intelligence using Analytics applied to geospatial data, oil and gas reports and other syndicated feeds in order to bid for new prospects (Hems & al, 2013). Identifying seismic traces: Using advanced analytics based on Hadoop and distributed Database for storage, quick visualization and comprehensive processing and imaging of seismic data (Seshadri, 2013) to identify potentially productive seismic trace signatures previously (Hems & al., 2013). Figure1 : High Performance Computing With a view to high success rate of of upstream exploration and explotation business of hydrocarbon industry seismic data processing and imaging, interpretationsterescopic rock visualization volume rendering, reservoir simulation are integral part of research and challenging task. The key challenge that the hydrocarbon industry must face for hydrocarbon exploration requires the development of state-of-the-art technologies to image subsurface precisely and reconstitute the three-dimensional structure of the Earth. High performance computing based on Graphics processing Unit (GPU)is a important direction of developments to meet the requirements of large scale computing in petroleum industry. By introducing several levels of parallelism, we can push the limit of computations and of optimization. Recent progress both on interconnect topology and new accelerating technology (FPGA, GPGPU, CELL) open new R&D directions to rectify & pacify the limits of computation. FPGA (Field-Programmable Gate Array) based neural networks implementations are increasingly used in conventional High Performance Computing applications where computational kernels such as FFT or convolution are performed on the FPGA instead of a microprocessor. The use of FPGAs for computing tasks is known as reconfigurable computing.general Purpose Computing on Graphics Processing
3 Units(GPGPU) with the increasing programmability of commodity graphics processing units (GPUs), these chips are capable of performing more than the specific graphics computations for which they were designed. They are now capable coprocessors, and their high speed makes them useful for a variety of applications. FWI(Full waveform inversion ) :Acoustic, Elastic, Visco-elastic, visco-aniso-elastic Seismic Hadoop Seismic Unix Seismic Hadoop combines Seismic Unix with Cloudera s distribution including Apache Hadoop to make it easy to execute common seismic data processing tasks on a Hadoop(Pig) cluster. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. The massively parallel intrinsic nature of seismic data allows the geophysicist to develop very efficient algorithms. Python seismic unix is very efficient for seismic subsurface imaging.big Data and Extreme-scale Computing (BDEC) is emerging field of research for high performance computing regarding seismic imaging. Figure2 : Hadoop for SEISMIC UNIX seismic imaging For nonstationary statistical geophysical signal analysis,we delve deep into Principal Component Analysis, Factor Analysis, Linear Discriminant Analysis; Independent Component Analysis,Blind Source Separation, Sparse Component Analysis by wavelet transform. Compressive sensing is a novel nonlinear sampling paradigm, effective for acquiring signals that have a sparse representation in some transform domain. The Curse of Dimensionality is rectified by dimension reduction employing PCA,LDA etc. The acquisition modality, information processing, and inference from observations often dictates the need to deal with tensors often big arrays of data collected in (hyper)cubes, thus generalizing the notion of data matrices. The growth of big data platforms makes it possible to solve largescale tensor problems. High-order tensors and their decompositions are abundantly present in domains such as statistical Signal Processing (e.g., high-order moments and sensor arrays), scientific computing (e.g., discretized multivariate functions), and quantum information theory (e.g., for quantum manybody states) quantum computing. Not surprisingly, some DSPG methods result from a straightforward mapping of time series to spectral graphs, which allows for drawing parallels from the former to the latter in notions as classical as filtering, spectral analysis, and transform theory. The discrete Fourier transform (DFT) is one of SP s workhorses, and its popular implementation relies on the celebrated fast Fourier transform (FFT). Recent developments, so-called sparse Fourier transform (SFT) implementation, which offers promises in certain large-scale data tasks involving sparse signals. The SFT can compute a compressed Fourier transform using only a subset of the input data in time, considerably shorter than the original data set size. SFT can thus be faster than the FFT when it is hard in large-scale applications to acquire enough data to run the FFT, and/or it is desirable to run DFT in time sublinear in the input size a welcome attribute in medical imaging, when it is important to reduce the time that the patient spends in the magnetic resonance imaging machine. A paradigm for the analysis of graph-based data based on the so-called discrete signal processing on graphs (DSPG) approach an effort to extend classical SP notions and techniques to data indexed by general graphs. The motivation should be clear: large data sets that are
4 naturally modeled as graphs are generated and analyzed in a wide range of applications, and extracting valuable information from these data requires innovative approaches. Pattern recognition for hydrocarbon exploration The use of pattern recognition has become more and more important in seismic oil exploration. Interpreting a large volume of seismic data is a challenging problem. Seismic reflection data in the one-shot seismogram and stacked seismogram may contain some structural information from the response of the subsurface. Syntactic/structural pattern recognition techniques can recognize the structural seismic patterns and improve seismic interpretations.the syntactic analysis methods include: (1) the error-correcting finite-state parsing, (2) the modified errorcorrecting Earley's parsing, (3) the parsing using the match primitive measure, (4) the Levenshtein distance computation, (5) the likelihood ratio test, (6) the error-correcting tree automata, and (7) a hierarchical system.syntactic seismic pattern recognition can be one of the milestones of a geophysical intelligent interpretation system. Pattern Recognition: The Paragon of Big Data Analytics-there are a few minor limitations associated with predictive analytics including:data modeling: Frequently facilitated by the paucity of data scientists, predictive analytics largely hinges on data models that are dependant on previous events to calculate the likelihood of future ones. Unexpected events may complicate if not outright evade this process, despite the fact that Machine Learning algorithms can minimize these instances.data Types: Such models are also restricted to certain types of data and sources, whether they are structured, unstructured or semi-structured.statistics: Predictive analytics is also circumscribed by a reliance on a linear relationship between variables, which does not take into account non-linear relationships and variables that have not been anticipated or accounted for in data models such as which are likely to be found in Big Data sets.touting what it refers to as its Natural Intelligence Platform, Saffron has unveiled a Cognitive Computing solution that forgoes predictive analytics for a much more profound way to identify the probability of future events based on real-time pattern recognition of Big Data sets. The CS-Storm system consists of multiple high-density multi-gpu server nodes, is well suited for HPC workloads in, oil and gas, pattern recognition, seismic processing, rendering and machine learning. CONCLUSION Now the oil and gas industry must educate big data on the types of data the industry captures in order to utilize the existing data in faster, smarter ways that focus on helping find and produce more hydrocarbons, at lower costs in economically sound and environmentally friendly ways. Big Data and microseismic imaging will accelerate the smart drilling oil and gas revolution. Seismic data generated in exponential manners as the upstream exploration and production cutting edge technology accelerates hydrocarbon industry to enhance R/P ratio of the nations. Seismic data processing,imaging and interpretations,modelling and simulation are integral part of subsurface deciphering with high performance computing. The Geoillustrator & interpreters focus on illustrative geology for subsurface precise imaging. Discrete Signal Processing on Graphs (DSPG) and Sparse Fourier Transform(SFT) are topics for lucrative creative research for Geophysical seismic signal processing. Wavelet analysis of seismic signal is integral part of big data analytics for hydrocarbon exploration and production.nano Imaging by third generation wavelet transform is prospective for digital rock physics. Econophysics of petroleum sector time series data- Joint Organisations Data Initiative (JODI) oil & gas data plays a pivotal role in big data analytics. By using state of the art computer graphics and interaction hardware, Geoillustrator contributes novel ideas to the science field of visualization and computer graphics. Modern-day seismic-data processing, imaging, and inversion rely increasingly on computationally and data-intensive techniques to meet society s continued demand for hydrocarbons. Acknowledgments
5 We are thankful to Computer centre BHU for providing computing & technical supports. We are grateful to Dr. John Stockwell,SEISMIC UNIX, I am highly obliged to Dr Lisa Gahagan Marine Seismic Data Center (MSDC) I have login/password approved by for seismic data. I also received Seismic data in LTO 4 tape (two) from Academic Seismic Portal at UTIG - Institute for Geophysics, University of Texas at Austin Antarctic Seismic Data Library System (SDLS) CNSOPB Data Management Centre, Canada-Nova Scotia Offshore Petroleum Board REFERENCES Baaziz A., Quoniam L., 2014, How to use Big Data technologies to optimize operations in Upstream Petroleum Industry, 21st World Petroleum Congress2014,Moscow. Baaziz A., Quoniam L., 2013, The information for the operational risk management in uncertain environments: Case of Early Kick Detection while drilling of the oil or gas wells, International Journal of Innovation and Applied Studies (IJIAS), Vol. 4 No. 1, Sep Brulé M., 2013, Tapping the power of Big Data for the oil and gas industry, IBM Software White Paper for Petroleum Industry, May 2013 Feblowitz J., 2012, The Big Deal About Big Data in Upstream Oil and Gas, Paper & presentation, IDC Energy Insights, October 2012 Hadoop, 2013, What Is Apache Hadoop?, Apache Hadoop Website, Available at: F, last update: 25 August 2013 Hems A., Soofi A., Perez E., 2013, Drilling for New Business Value: How innovative oil and gas companies are using Big Data to outmaneuver the competition, A Microsoft White Paper, May 2013 Hollingsworth J., 2013, Big Data For Oil & Gas, Oracle Oil & Gas Industry Business Unit, March 2013 JDN, 2013, Panorama des solutions de BIG DATA : Hadoop et son écosystème, Journal du Net, Available at: last update : 04 July 2013 Nicholson R., 2012, Big Data in the Oil & Gas Industry, IDC Energy Insights, September 2012 Seshadri M., 2013, Big Data Science Challenging The Oil Industry, CTO Global Services, EMC Corporation, March 2013 Keith Holdaway,2014,Harness Oil and Gas Big Data with Analytics: Optimize Exploration and Production with Data Driven Models (Wiley and SAS Business Series),pp384 Kou-Yuan Huang,2002,Syntactic Pattern Recognition for Seismic Oil Exploration, Series in Machine Perception and Artificial Intelligence: Volume 46, 148pp ISBN: Georgios B. Giannakis, Francis Bach, Raphael Cendrillon, Michael Mahoney, and Jennifer Neville,2014 Signal Processing for Big Data IEEE SIGNAL PROCESSING MAGAZINE SEPTEMBER 2014 PP15-16 Digital Object Identifier /MSP Aliaksei Sandryhaila and José M.F. Moura,2014, Big Data Analysis with Signal Processing on Graphs, IEEE SIGNAL PROCESSING MAGAZINE, SEPTEMBER 2014 pp Digital Object Identifier /MSP cial-issues-2/ cial-issues-2/ IEEE Signal Processing Magazine Special Issue on Geophysical Signal Processing, Part II, July Special Issue on Geophysical Signal Processing, Part I, May Signal Processing for Big Data, September Time-Frequency Analysis and Applications, November # IEEE Signal Processing,SAM-GSSP Geophysical and seismic signal processing IEEE Journal of Selected Topics in Signal Processing Signal Processing for Big Data, June 2015 IEEE Signal Processing,SAM-GSSP Geophysical and seismic signal processing, Hadoop combines Seismic Unix with Cloudera's Distribution including Apache Hadoop SEISMIC UNIX SEISMIC DATA,GPR Bore Hole Radar VRP(Vertical Radar Profiling),VSP (Vertical Seismic Profiling) CWP/SU: Seismic Unix - Center for Wave Phenomena, seismicunix.com mines.edu/sututor m SeismicUnix PSEIS Parallel Seismic Earth Imaging System, The Free Unix Seismic Processing system (FreeUSP) er/tutorials/processing_2d/processing_2d.html Man_Functionality/Man_Functionality.html software Man_Functionality/Man_Functionality.html
6 HPC in Oil and Gas Exploration Prace, the Partnership for Advanced Computing in Europe, Addressing Energy in Parallel Technologies ADEPT,apos-project.eu/Articles/reservoir-simulation-inthe-oil-industry.html Kaleidoscope Project, Society of High Performance Computing Professionals hpcoilgas.citris-uc.org/hpcsociety.org/ European Exascale Software Initiative (EESI) European Technology Platform For High Performance Computing ETP4HPC Association,Kaleidoscope of (Apache) Big Data Stack (ABDS) and HPC Technologies International Exascale Software Project (IESP), EESI project - The European Exascale Software Initiative (Dynamical Exascale Entry Platform). (DEEP Extended Reach) Research into ExascaleSystemware, Tools and Applications Big Data and Extreme Scale Computing challenges in Solid Earth Sciences is primarily designed to provide data services for European researchers. Researchers (from academia and industry) can share, discover and re-use data via the EUDAT CDI services, Virtual Earthquake and seismology Research Community in Europe e- science environment(verce), Plate Observing System (EPOS),VERCE: Seismic modelling, QUEST (QUantitative Estimation of Earth's Seismic Sources and STructure) / SPICE Seismic wave Propagation and Imaging in Complex media: a European network org/cig/software/ POWERS (Parallel Oil,. Water and Gas Enhanced Reservoir Simulator) ws/latest-news/2010/saudi-aramco-unveilsgigapowerstm.html?switchtomobile=1 HPC - Research Computing to Economic Development in Saudi Arabia, kaust.edu.sa Earth Sciences and Engineering/The Seismic Wave Analysis Group (SWAG) 01.ibm.com/software/data/bigdata/industry-oil.html hadoop-and-big-data.html exploration and production with big data in oil & gas/ibm Big Data for Oil and Gas ring-and-resources/oil-and-gas-mining/articles/theappeal-of-big-data-in-oil-and-gas.aspx 509_excerpt.pdf Analytics/dp/ Nimbix Accelerates Cloud-Based, High-Performance Data Analysis Solution With NVIDIA Tesla and Grid GPUs/Powerful Seismic Processing and Visualization Capabilities Address Big Data Analytics Requirements for Oil & Gas Industry Key_to_Increase_Productivity_and_Competitiveness.pdf /international-council-for-science-icsu-and-thechallenges-of-big-data-in-science/
7
How to use Big Data technologies to optimize operations in Upstream Petroleum Industry
How to use Big Data technologies to optimize operations in Upstream Petroleum Industry Abdelkader Baaziz Ph.D. Student and Resercher at IRSIC Laboratory, Aix-Marseille University E-mail: abdelkader.baaziz@etu.univ-amu.fr
More informationHow to use Big Data technologies to optimize operations in Upstream Petroleum Industry
How to use Big Data technologies to optimize operations in Upstream Petroleum Industry Abdelkader Baaziz, Luc Quoniam To cite this version: Abdelkader Baaziz, Luc Quoniam. How to use Big Data technologies
More informationHow to use Big Data technologies to optimize operations in Upstream Petroleum Industry
How to use Big Data technologies to optimize operations in Upstream Petroleum Industry Abdelkader Baaziz, Luc Quoniam To cite this version: Abdelkader Baaziz, Luc Quoniam. How to use Big Data technologies
More informationHow to use Big Data technologies to optimize operations in Upstream Petroleum Industry
Block: 4 Sustainable Management of the Industry Forum: F22 The role of innovation and technology in shaping the oil and gas industry How to use Big Data technologies to optimize operations in Upstream
More informationHigh Performance Data Management Use of Standards in Commercial Product Development
v2 High Performance Data Management Use of Standards in Commercial Product Development Jay Hollingsworth: Director Oil & Gas Business Unit Standards Leadership Council Forum 28 June 2012 1 The following
More informationGlobal Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.935.4400 F.508.988.7881 www.idc-ei.com
Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.935.4400 F.508.988.7881 www.idc-ei.com T h e Big Deal About Big Data in Upstream O i l a n d Gas W H I T E P A P E R Sponsored by: Hitachi
More informationCollecting and Analyzing Big Data for O&G Exploration and Production Applications October 15, 2013 G&G Technology Seminar
Eldad Weiss Founder and Chairman Collecting and Analyzing Big Data for O&G Exploration and Production Applications October 15, 2013 G&G Technology Seminar About Paradigm 700+ 26 700+ 29 7 15,000+ 15+ 200M+
More informationSanjeev Kumar. contribute
RESEARCH ISSUES IN DATAA MINING Sanjeev Kumar I.A.S.R.I., Library Avenue, Pusa, New Delhi-110012 sanjeevk@iasri.res.in 1. Introduction The field of data mining and knowledgee discovery is emerging as a
More informationTapping the power of big data for the oil and gas industry
IBM Software White Paper Petroleum Industry Tapping the power of big data for the oil and gas industry 2 Tapping the power of big data for the oil and gas industry The petroleum industry is no stranger
More informationData Centric Systems (DCS)
Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems
More informationImpact of Big Data in Oil & Gas Industry. Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India.
Impact of Big Data in Oil & Gas Industry Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India. New Age Information 2.92 billions Internet Users in 2014 Twitter processes 7 terabytes
More informationBIG DATA & ANALYTICS. Transforming the business and driving revenue through big data and analytics
BIG DATA & ANALYTICS Transforming the business and driving revenue through big data and analytics Collection, storage and extraction of business value from data generated from a variety of sources are
More informationThe 4 Pillars of Technosoft s Big Data Practice
beyond possible Big Use End-user applications Big Analytics Visualisation tools Big Analytical tools Big management systems The 4 Pillars of Technosoft s Big Practice Overview Businesses have long managed
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationData Refinery with Big Data Aspects
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data
More informationInternational Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop
ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com
More informationData-intensive HPC: opportunities and challenges. Patrick Valduriez
Data-intensive HPC: opportunities and challenges Patrick Valduriez Big Data Landscape Multi-$billion market! Big data = Hadoop = MapReduce? No one-size-fits-all solution: SQL, NoSQL, MapReduce, No standard,
More information5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014
5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for
More informationHow To Create A Data Science System
Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Richard Breakiron Senior Director, Cyber Solutions Rbreakiron@vion.com Office: 571-353-6127 / Cell: 803-443-8002
More informationSpatio-Temporal Networks:
Spatio-Temporal Networks: Analyzing Change Across Time and Place WHITE PAPER By: Jeremy Peters, Principal Consultant, Digital Commerce Professional Services, Pitney Bowes ABSTRACT ORGANIZATIONS ARE GENERATING
More informationManaging Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database
Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica
More informationHarness Oil and Gas Big Data with Analytics. Optimize Exploration and Production with Data Driven Models. Wiley and SAS Business Series
Brochure More information from http://www.researchandmarkets.com/reports/2708334/ Harness Oil and Gas Big Data with Analytics. Optimize Exploration and Production with Data Driven Models. Wiley and SAS
More informationBig Data and Data Science: Behind the Buzz Words
Big Data and Data Science: Behind the Buzz Words Peggy Brinkmann, FCAS, MAAA Actuary Milliman, Inc. April 1, 2014 Contents Big data: from hype to value Deconstructing data science Managing big data Analyzing
More informationGain insight, agility and advantage by analyzing change across time and space.
White paper Location Intelligence Gain insight, agility and advantage by analyzing change across time and space. Spatio-temporal information analysis is a Big Data challenge. The visualization and decision
More informationBig Data. Fast Forward. Putting data to productive use
Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationInformation Visualization WS 2013/14 11 Visual Analytics
1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and
More informationHow innovative oil and gas companies are using big data to outmaneuver the competition.
Drilling for New Business Value How innovative oil and gas companies are using big data to outmaneuver the competition. A Microsoft White Paper Adam Hems, Industry Technical Strategist, Oil & Gas and Mining,
More informationArchitecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing
Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics
More informationSmarter Planet evolution
Smarter Planet evolution 13/03/2012 2012 IBM Corporation Ignacio Pérez González Enterprise Architect ignacio.perez@es.ibm.com @ignaciopr Mike May Technologies of the Change Capabilities Tendencies Vision
More informationHue Streams. Seismic Compression Technology. Years of my life were wasted waiting for data loading and copying
Hue Streams Seismic Compression Technology Hue Streams real-time seismic compression results in a massive reduction in storage utilization and significant time savings for all seismic-consuming workflows.
More informationA Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data
White Paper A Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data Contents Executive Summary....2 Introduction....3 Too much data, not enough information....3 Only
More informationA Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks
A Systemic Artificial Intelligence (AI) Approach to Difficult Text Analytics Tasks Text Analytics World, Boston, 2013 Lars Hard, CTO Agenda Difficult text analytics tasks Feature extraction Bio-inspired
More informationBig Data: Image & Video Analytics
Big Data: Image & Video Analytics How it could support Archiving & Indexing & Searching Dieter Haas, IBM Deutschland GmbH The Big Data Wave 60% of internet traffic is multimedia content (images and videos)
More informationKeywords Big Data; OODBMS; RDBMS; hadoop; EDM; learning analytics, data abundance.
Volume 4, Issue 11, November 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Analytics
More informationIntegrating a Big Data Platform into Government:
Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government
More informationIBM Deep Computing Visualization Offering
P - 271 IBM Deep Computing Visualization Offering Parijat Sharma, Infrastructure Solution Architect, IBM India Pvt Ltd. email: parijatsharma@in.ibm.com Summary Deep Computing Visualization in Oil & Gas
More informationMaster big data to optimize the oil and gas lifecycle
Viewpoint paper Master big data to optimize the oil and gas lifecycle Information management and analytics (IM&A) helps move decisions from reactive to predictive Table of contents 4 Getting a handle on
More informationDanny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
More informationVIEWPOINT. High Performance Analytics. Industry Context and Trends
VIEWPOINT High Performance Analytics Industry Context and Trends In the digital age of social media and connected devices, enterprises have a plethora of data that they can mine, to discover hidden correlations
More informationBIG DATA AND ANALYTICS
BIG DATA AND ANALYTICS Björn Bjurling, bgb@sics.se Daniel Gillblad, dgi@sics.se Anders Holst, aho@sics.se Swedish Institute of Computer Science AGENDA What is big data and analytics? and why one must bother
More informationSunnie Chung. Cleveland State University
Sunnie Chung Cleveland State University Data Scientist Big Data Processing Data Mining 2 INTERSECT of Computer Scientists and Statisticians with Knowledge of Data Mining AND Big data Processing Skills:
More informationANALYTICS BUILT FOR INTERNET OF THINGS
ANALYTICS BUILT FOR INTERNET OF THINGS Big Data Reporting is Out, Actionable Insights are In In recent years, it has become clear that data in itself has little relevance, it is the analysis of it that
More informationHow To Make Sense Of Data With Altilia
HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. ALTILIA turns Big Data into Smart Data and enables businesses to
More informationBig Data Executive Survey
Big Data Executive Full Questionnaire Big Date Executive Full Questionnaire Appendix B Questionnaire Welcome The survey has been designed to provide a benchmark for enterprises seeking to understand the
More informationIs a Data Scientist the New Quant? Stuart Kozola MathWorks
Is a Data Scientist the New Quant? Stuart Kozola MathWorks 2015 The MathWorks, Inc. 1 Facts or information used usually to calculate, analyze, or plan something Information that is produced or stored by
More informationHur hanterar vi utmaningar inom området - Big Data. Jan Östling Enterprise Technologies Intel Corporation, NER
Hur hanterar vi utmaningar inom området - Big Data Jan Östling Enterprise Technologies Intel Corporation, NER Legal Disclaimers All products, computer systems, dates, and figures specified are preliminary
More informationW H I T E P A P E R. Building your Big Data analytics strategy: Block-by-Block! Abstract
W H I T E P A P E R Building your Big Data analytics strategy: Block-by-Block! Abstract In this white paper, Impetus discusses how you can handle Big Data problems. It talks about how analytics on Big
More informationBig Data Technology ดร.ช ชาต หฤไชยะศ กด. Choochart Haruechaiyasak, Ph.D.
Big Data Technology ดร.ช ชาต หฤไชยะศ กด Choochart Haruechaiyasak, Ph.D. Speech and Audio Technology Laboratory (SPT) National Electronics and Computer Technology Center (NECTEC) National Science and Technology
More informationBIG DATA TRENDS AND TECHNOLOGIES
BIG DATA TRENDS AND TECHNOLOGIES THE WORLD OF DATA IS CHANGING Cloud WHAT IS BIG DATA? Big data are datasets that grow so large that they become awkward to work with using onhand database management tools.
More informationSurfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics
Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Dr. Liangxiu Han Future Networks and Distributed Systems Group (FUNDS) School of Computing, Mathematics and Digital Technology,
More informationHigh Performance Computing and Big Data: The coming wave.
High Performance Computing and Big Data: The coming wave. 1 In science and engineering, in order to compete, you must compute Today, the toughest challenges, and greatest opportunities, require computation
More informationInternational Journal of Innovative Research in Computer and Communication Engineering
FP Tree Algorithm and Approaches in Big Data T.Rathika 1, J.Senthil Murugan 2 Assistant Professor, Department of CSE, SRM University, Ramapuram Campus, Chennai, Tamil Nadu,India 1 Assistant Professor,
More informationData Centric Computing Revisited
Piyush Chaudhary Technical Computing Solutions Data Centric Computing Revisited SPXXL/SCICOMP Summer 2013 Bottom line: It is a time of Powerful Information Data volume is on the rise Dimensions of data
More informationChapter 7. Using Hadoop Cluster and MapReduce
Chapter 7 Using Hadoop Cluster and MapReduce Modeling and Prototyping of RMS for QoS Oriented Grid Page 152 7. Using Hadoop Cluster and MapReduce for Big Data Problems The size of the databases used in
More informationHow to Leverage Big Data in the Cloud to Gain Competitive Advantage
How to Leverage Big Data in the Cloud to Gain Competitive Advantage James Kobielus, IBM Big Data Evangelist Editor-in-Chief, IBM Data Magazine Senior Program Director, Product Marketing, Big Data Analytics
More informationSAP Solution Brief SAP HANA. Transform Your Future with Better Business Insight Using Predictive Analytics
SAP Brief SAP HANA Objectives Transform Your Future with Better Business Insight Using Predictive Analytics Dealing with the new reality Dealing with the new reality Organizations like yours can identify
More informationA Strategic Approach to Unlock the Opportunities from Big Data
A Strategic Approach to Unlock the Opportunities from Big Data Yue Pan, Chief Scientist for Information Management and Healthcare IBM Research - China [contacts: panyue@cn.ibm.com ] Big Data or Big Illusion?
More informationOutline. What is Big data and where they come from? How we deal with Big data?
What is Big Data Outline What is Big data and where they come from? How we deal with Big data? Big Data Everywhere! As a human, we generate a lot of data during our everyday activity. When you buy something,
More informationBig Workflow: More than Just Intelligent Workload Management for Big Data
Big Workflow: More than Just Intelligent Workload Management for Big Data Michael Feldman White Paper February 2014 EXECUTIVE SUMMARY Big data applications represent a fast-growing category of high-value
More informationwww.xenon.com.au STORAGE HIGH SPEED INTERCONNECTS HIGH PERFORMANCE COMPUTING VISUALISATION GPU COMPUTING
www.xenon.com.au STORAGE HIGH SPEED INTERCONNECTS HIGH PERFORMANCE COMPUTING GPU COMPUTING VISUALISATION XENON Accelerating Exploration Mineral, oil and gas exploration is an expensive and challenging
More informationData Intensive Science and Computing
DEFENSE LABORATORIES ACADEMIA TRANSFORMATIVE SCIENCE Efficient, effective and agile research system INDUSTRY Data Intensive Science and Computing Advanced Computing & Computational Sciences Division University
More informationMicrosoft - Oil and Gas
Microsoft - Oil and Gas Upstream IT Reference Architecture Introduction Today s oil and gas industry needs a common information technology (IT) reference architecture for use by upstream organizations,
More informationInternational Journal of Computer Science Trends and Technology (IJCST) Volume 2 Issue 3, May-Jun 2014
RESEARCH ARTICLE OPEN ACCESS A Survey of Data Mining: Concepts with Applications and its Future Scope Dr. Zubair Khan 1, Ashish Kumar 2, Sunny Kumar 3 M.Tech Research Scholar 2. Department of Computer
More informationBusiness Analytics and the Nexus of Information
Business Analytics and the Nexus of Information 2 The Impact of the Nexus of Forces 4 From the Gartner Files: Information and the Nexus of Forces: Delivering and Analyzing Data 6 About IBM Business Analytics
More informationBig Data. Sonovate QuickView Series #3
Big Data Sonovate QuickView Series #3 The most valuable commodity I know of is information. - Gordon Gekko Big data is changing the world dramatically right before our eyes from the amount of data being
More informationThe Big Data Paradigm Shift. Insight Through Automation
The Big Data Paradigm Shift Insight Through Automation Agenda The Problem Emcien s Solution: Algorithms solve data related business problems How Does the Technology Work? Case Studies 2013 Emcien, Inc.
More informationBig Data and the new trends for BI and Analytics Juha Teljo Business Intelligence and Predictive Solutions Executive IBM Europe
Big Data and the new trends for BI and Analytics Juha Teljo Business Intelligence and Predictive Solutions Executive IBM Europe 2012 IBM Corporation The Mega Trends Cloud Mobile Social Analytics 2014 International
More informationHadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services
Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012 Viswa Sharma Solutions Architect Tata Consultancy Services 1 Agenda What is Hadoop Why Hadoop? The Net Generation is here Sizing the
More informationGovernment Technology Trends to Watch in 2014: Big Data
Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require
More informationBIG DATA IN BUSINESS ENVIRONMENT
Scientific Bulletin Economic Sciences, Volume 14/ Issue 1 BIG DATA IN BUSINESS ENVIRONMENT Logica BANICA 1, Alina HAGIU 2 1 Faculty of Economics, University of Pitesti, Romania olga.banica@upit.ro 2 Faculty
More informationCollaborative Big Data Analytics. Copyright 2012 EMC Corporation. All rights reserved.
Collaborative Big Data Analytics 1 Big Data Is Less About Size, And More About Freedom TechCrunch!!!!!!!!! Total data: bigger than big data 451 Group Findings: Big Data Is More Extreme Than Volume Gartner!!!!!!!!!!!!!!!
More informationBig Data Processing and Analytics for Mouse Embryo Images
Big Data Processing and Analytics for Mouse Embryo Images liangxiu han Zheng xie, Richard Baldock The AGILE Project team FUNDS Research Group - Future Networks and Distributed Systems School of Computing,
More informationOracle Big Data SQL Technical Update
Oracle Big Data SQL Technical Update Jean-Pierre Dijcks Oracle Redwood City, CA, USA Keywords: Big Data, Hadoop, NoSQL Databases, Relational Databases, SQL, Security, Performance Introduction This technical
More informationBeyond Watson: The Business Implications of Big Data
Beyond Watson: The Business Implications of Big Data Shankar Venkataraman IBM Program Director, STSM, Big Data August 10, 2011 The World is Changing and Becoming More INSTRUMENTED INTERCONNECTED INTELLIGENT
More informationEVERYTHING THAT MATTERS IN ADVANCED ANALYTICS
EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS Marcia Kaufman, Principal Analyst, Hurwitz & Associates Dan Kirsch, Senior Analyst, Hurwitz & Associates Steve Stover, Sr. Director, Product Management, Predixion
More informationANALYTICS CENTER LEARNING PROGRAM
Overview of Curriculum ANALYTICS CENTER LEARNING PROGRAM The following courses are offered by Analytics Center as part of its learning program: Course Duration Prerequisites 1- Math and Theory 101 - Fundamentals
More informationKeywords Big Data, NoSQL, Relational Databases, Decision Making using Big Data, Hadoop
Volume 4, Issue 1, January 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Transitioning
More informationEXPLORATION TECHNOLOGY REQUIRES A RADICAL CHANGE IN DATA ANALYSIS
EXPLORATION TECHNOLOGY REQUIRES A RADICAL CHANGE IN DATA ANALYSIS EMC Isilon solutions for oil and gas EMC PERSPECTIVE TABLE OF CONTENTS INTRODUCTION: THE HUNT FOR MORE RESOURCES... 3 KEEPING PACE WITH
More informationDecisionSpace. Prestack Calibration and Analysis Software. DecisionSpace Geosciences DATA SHEET
DATA SHEET DecisionSpace Prestack Calibration and Analysis Software DecisionSpace Geosciences Key Features Large-volume prestack interpretation and analysis suite Advanced prestack analysis workflows native
More informationDr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory. The Nation s Premier Laboratory for Land Forces UNCLASSIFIED
Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory 21 st Century Research Continuum Theory Theory embodied in computation Hypotheses tested through experiment SCIENTIFIC METHODS
More informationExtend your analytic capabilities with SAP Predictive Analysis
September 9 11, 2013 Anaheim, California Extend your analytic capabilities with SAP Predictive Analysis Charles Gadalla Learning Points Advanced analytics strategy at SAP Simplifying predictive analytics
More informationElena Terenzi. Technology Advisor for Big Data in Oil and Gas Microsoft
Elena Terenzi Technology Advisor for Big Data in Oil and Gas Microsoft Oil&Gas Landscape How Microsoft is helping companies in Oil&Gas being successful Microsoft solutions in Oil&Gas space Start reimagining
More informationStatistics for BIG data
Statistics for BIG data Statistics for Big Data: Are Statisticians Ready? Dennis Lin Department of Statistics The Pennsylvania State University John Jordan and Dennis K.J. Lin (ICSA-Bulletine 2014) Before
More informationIBM Big Data Platform
IBM Big Data Platform Turning big data into smarter decisions Stefan Söderlund. IBM kundarkitekt, Försvarsmakten Sesam vår-seminarie Big Data, Bigga byte kräver Pigga Hertz! May 16, 2013 By 2015, 80% of
More information14TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF
14 TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF August 3 6, 2015 I Rio de Janeiro, RJ Sulamérica Convention Center, Booth #49 Solving challenges. Theatre Schedule: Booth #49
More informationIBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!
The Bloor Group IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS VENDOR PROFILE The IBM Big Data Landscape IBM can legitimately claim to have been involved in Big Data and to have a much broader
More informationA TOP-RATED UNIVERSITY FOR EMPLOYABILITY. MSc IT for the Oil and Gas Industry. T: 01224 262787 262705 h.ahriz@rgu.ac.uk. d.p.lonie@rgu.ac.
A TOP-RATED UNIVERSITY FOR EMPLOYABILITY MSc IT for the Oil and Gas Industry T: 01224 262787 262705 h.ahriz@rgu.ac.uk d.p.lonie@rgu.ac.uk PROGRAMME OVERVIEW The Oil and Gas Industry involves the acquisition,
More informationBIG DATA IN OIL AND GAS: HOW TO TAP ITS FULL POTENTIAL
BIG DATA IN OIL AND GAS: HOW TO TAP ITS FULL POTENTIAL JILL FEBLOWITZ, VICE PRESIDENT, IDC ENERGY INSIGHTS LARRY RICE, GLOBAL DIRECTOR, ENERGY INDUSTRIES, HITACHI DATA SYSTEMS BERT BEALS, CHIEF TECHNOLOGIST,
More informationOutline. High Performance Computing (HPC) Big Data meets HPC. Case Studies: Some facts about Big Data Technologies HPC and Big Data converging
Outline High Performance Computing (HPC) Towards exascale computing: a brief history Challenges in the exascale era Big Data meets HPC Some facts about Big Data Technologies HPC and Big Data converging
More informationTransforming the Telecoms Business using Big Data and Analytics
Transforming the Telecoms Business using Big Data and Analytics Event: ICT Forum for HR Professionals Venue: Meikles Hotel, Harare, Zimbabwe Date: 19 th 21 st August 2015 AFRALTI 1 Objectives Describe
More informationAPPROACHABLE ANALYTICS MAKING SENSE OF DATA
APPROACHABLE ANALYTICS MAKING SENSE OF DATA AGENDA SAS DELIVERS PROVEN SOLUTIONS THAT DRIVE INNOVATION AND IMPROVE PERFORMANCE. About SAS SAS Business Analytics Framework Approachable Analytics SAS for
More informationGraduate Co-op Students Information Manual. Department of Computer Science. Faculty of Science. University of Regina
Graduate Co-op Students Information Manual Department of Computer Science Faculty of Science University of Regina 2014 1 Table of Contents 1. Department Description..3 2. Program Requirements and Procedures
More informationA bachelor of science degree in electrical engineering with a cumulative undergraduate GPA of at least 3.0 on a 4.0 scale
What is the University of Florida EDGE Program? EDGE enables engineering professional, military members, and students worldwide to participate in courses, certificates, and degree programs from the UF
More informationManifest for Big Data Pig, Hive & Jaql
Manifest for Big Data Pig, Hive & Jaql Ajay Chotrani, Priyanka Punjabi, Prachi Ratnani, Rupali Hande Final Year Student, Dept. of Computer Engineering, V.E.S.I.T, Mumbai, India Faculty, Computer Engineering,
More informationLaurence Liew General Manager, APAC. Economics Is Driving Big Data Analytics to the Cloud
Laurence Liew General Manager, APAC Economics Is Driving Big Data Analytics to the Cloud Big Data 101 The Analytics Stack Economics of Big Data Convergence of the 3 forces Big Data Analytics in the Cloud
More informationSURVEY REPORT DATA SCIENCE SOCIETY 2014
SURVEY REPORT DATA SCIENCE SOCIETY 2014 TABLE OF CONTENTS Contents About the Initiative 1 Report Summary 2 Participants Info 3 Participants Expertise 6 Suggested Discussion Topics 7 Selected Responses
More informationHow to use Big Data in Industry 4.0 implementations. LAURI ILISON, PhD Head of Big Data and Machine Learning
How to use Big Data in Industry 4.0 implementations LAURI ILISON, PhD Head of Big Data and Machine Learning Big Data definition? Big Data is about structured vs unstructured data Big Data is about Volume
More information