1 International Journal of Computer Science and Applications, Technomathematics Research Foundation Vol. 11, No. 3, pp , 2014 ANALYTICS ON BIG AVIATION DATA: TURNING DATA INTO INSIGHTS RAJENDRA AKERKAR Western Norway Research Institute Sogndal, Norway The business world is undergoing a revolution driven by the use of data and analytics to guide decision-making. While many forces are at work, a major reason for the business analytics revolution is the rapid proliferation of the amount of data available to be analysed. Recent days, big data is beginning to have a major impact on air travel with more data being created both through the plane sensors and the passengers on board; the opportunities to use this data will only increase. It provides innovative companies with the opportunity to improve major aspects of their business, from using data to improve customer retention through to making planes safer and more reliable. In this paper we discuss a big data concept, definitions, and further present some cases for aviation industry to analyse data from every conceivable channel, for instance, customer data to create a unique profile for each customer based on a wide range of demographic data, behaviours, and preferences. Keywords: big data; data processing; aviation; analytics. 1. Big Data Concept Data, or pieces of information, have been collected and used right through history. However, in contemporary world, advances in digital technology have considerably boosted our ability to collect, store, and analyse data. All of the data, however, are merely that data until they are analysed and used to inform decision-making. The use of the term big data can be traced back to debates of managing large amount of datasets in both academia and industry during the 1980s. Big data arose due to the emergence of three major trends. First, it has become economical to generate a broad kind of data, due to inexpensive storage, sensors, smart devices, social software, multiplayer games, and the Internet of Things. Second, it has become inexpensive to process huge amounts of data, due to progresses in multicore CPUs, solid state storage, cloud computing, and open source software. Thirdly, not just database administrators and developers, but many more people (such as decision makers, domain scientists, application users, journalists, and ordinary consumers) have become involved in the process of generating, processing, and consuming data. This is known as a democratization of data. As a result of these accelerating trends, there is now a widespread realization that an unprecedented volume of data can be captured, stored, and processed, and that the knowledge gleaned from such data can benefit everyone: businesses, governments, academic disciplines, engineering, communities, and individuals. 116
2 Analytics on Big Data using Real Time Data Processing 117 With varied data provisions, such as sensor networks, telescopes, scientific experiments, and high throughput instruments, the datasets increase at exponential rate [Szalay et al 06, Lynch 08]. The off-the-shelf techniques and technologies that are available to store and analyse data cannot work efficiently and adequately. The technical challenges arise from data acquisition and data curation to data analysis and data visualization. Big data has changed the way that we adopt in doing businesses, managements and explorations. Data-intensive computing is coming into the world that aims to provide the tools that we need to handle the big data problems. Data-intensive science [Bell et al 09] is emerging as the fourth scientific paradigm in terms of the previous three, namely empirical science, theoretical science and computational science. Long ago, researchers describing the natural phenomenon only based on human empirical evidences, so we call the science at that time as empirical science. It is also the beginning of science and classified as the first paradigm. Then, theoretical science emerged some hundreds years ago as the second paradigm. However, in terms of many complex phenomenon and problems, scientists have to turn to scientific simulations, since theoretical analysis is highly complicated and sometimes inaccessible and infeasible. Subsequently, the third science paradigm was the computational one. Simulations usually generate a large volume of data from the experimental science, at the same time; increasingly large data sets are created in various pipelines. There is no doubt that the world of science has changed just because of the increasing data-intensive applications. In 2012, Gartner recorded the Top 10 Strategic Technology Trends For 2013 [Savitz 12a] and Top 10 Critical Tech Trends for the Next Five Years [Savitz 12b], and big data is listed in the both places. Without doubt, in near future big data will transform many fields, including business, the scientific research, and public administration. In order to discuss about various issues related to big data, it is necessary to understand different facets about big data. For the definition of the big data, there are various different explanations from 3Vs to 4Vs. Doug Laney used volume, velocity and variety, known as 3Vs [Laney 01], to present data related challenges. In literature, we come across definitions of big data using these 3 Vs: Volume data sizes will range from terabytes to zettabytes. Variety data comes in many formats from structured data, organized according to some structures like the data record, to unstructured data, like image, sounds, and videos which are much more difficult to search and analyse. Velocity in several applications, like smart cities and smart planet, data continuously arrives at possible very high frequencies, resulting in continuous high-speed data streams. It is crucial that the time needed to act on such data be very small. Occasionally, people use another V according to their special requirements. The fourth V can be value, variability, veracity, or virtual [Zikopoulos et al 11]. In general, big data is a collection of massive data sets with an immense diversity of types so that it becomes difficult to process by using state-of-the-art data processing approaches or traditional data processing platforms.
3 118 Rajendra Akerkar 1.1. Common Definitions Sub-headings Big data is still in its early stages, everyone is still trying to grasp its core nature and to define it scientifically and pragmatically. Nonetheless the precise meaning of the concept remains unclear and is often used synonymously with other related concepts such as Business Intelligence (BI) and data mining[akerkar & Lingras, 08]. Several stakeholders have created new definitions or revisions of existing definitions that best suit their interests. Nevertheless, to capture the core of big data, consistent themes can be found by examining various definitions provided by the industry gurus and related literature. Among several definitions reported in the literature, the first formal, academic definition appears in a paper submitted in July 2000 by Francis Diebold in his work of econometrics and statistics [Diebold 00]: Big data refers to the explosion in the quantity (and sometimes, quality) of available and potentially relevant data, largely the result of recent and unprecedented advancements in data recording and storage technology. In this new and exciting world, sample sizes are no longer fruitfully measured in number of observations, but rather in, say, megabytes. Even data accruing at the rate of several gigabytes per day are not uncommon. The most popular definition in recent years uses the Three V s : volume (size of datasets and storage), velocity (speed of incoming data), and variety (data types). Reacting fast enough to deal with data velocity is a challenge for most organizations. As mentioned in the section 2, the concept was first raised by Doug Laney (2001) in his META Group research note that describes the characteristics of datasets that cannot be handled by traditional data management tools. With increasing interest and insight in the field, the Three V s have been expanded to Five V s : volume, velocity, variety, veracity (integrity of data), value (usefulness of data) and complexity (degree of interconnection among data structures) [Armour 12]. However, the soul of these V s remains within the extent of data characteristics per se. Another noteworthy definition presented by Brian Hopkins and Boris Evelson. According to them, if we simply have high volume or velocity, then big data may not be appropriate. The definition described in Expand your digital horizon with big data 1 : Big data: techniques and technologies that make handling data at extreme scale economical. The two main characteristics are volume and velocity, while variety and variability shift the curve. In other words, extreme scale is more economical, and more economical means more people do it, leading to more solutions. More comprehensive definitions and descriptions have also emerged. For example, In its report, Demystifying big data, the big data commission at the TechAmerica Foundation offers the following definition: 1
4 Analytics on Big Data using Real Time Data Processing 119 Big data is a term that describes large volumes of high-velocity, complex, and variable data that require advanced techniques and technologies to enable the capture, storage, distribution, management, and analysis of the information [TechAmerica 12]. Researchers at McKinsey propose a subjective definition: Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyse [McKinsey 11]. The definition of big data can vary by sector, depending on what kinds of software tools are normally available and what sizes of datasets are common in a particular industry. Big data in several sectors at the moment range from a few dozen terabytes to multiple petabytes. IBM 2 states that big data involves notable amounts of data that comes from a wide variety of sources. IBM highlights the increasing speed of data generation. Every day, we create 2.5 quintillion bytes of data so much that 90% of the data in the world today has been created in the last two years alone. This data comes from everywhere: sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals to name a few. This data is big data. Big data is the frontier of a firm s ability to store, process, and access (SPA) all the data it needs to operate effectively, make decisions, reduce risks, and serve customers [Gualtieri 12]. A mathematically sound definition of big data: Big data represents the historical debri (observed data) resulting from the interaction of at between 70 and 77 independent variable/subjects, from which non-random samples of unknown populations, shifting in composition with a targeted time frame, can be taken [Smith 12]. Some more definitions of big data presented in literature are as follows: Association for Data-driven Marketing & Advertising (ADMA) 3, Sydney has provided global, commercial and marketing definitions of big data. Global definition of big data Big data is the collection of large volumes of varied information, used to extend our understanding of the environment, medicine, science, business and human experience. Commercial definition of big data Big data is the current term given to the wide use of data collected from digital, technological, and analogue sources. Big data is used to improve business understanding of markets, allowing improvements in customer experience and organisational performance. Marketing definition of big data Big data is the current term given to collecting, analysing and generating insights from a wide variety of customer, commercial and environmental information
5 120 Rajendra Akerkar It is used to develop better understanding of customer preferences, habits and considerations in making transactions with different categories, brands and channels. The successful use of data in marketing leads to improved customer experience, a better exchange of value between customers and organisations, and improved business performance. SAP 4 offers a more promotion oriented view on big data. Big data is an opportunity to change how you work, play, and live by tracking new signals within digital noise. From major league sports and personalized shopping to carbon reduction and cancer treatment, organizations are using big data to re-imagine achieving what is possible. Clearly, SAP is focusing on the benefits of big data rather than delivering a straightforward definition of the concept. Besides, SAP is underlining the fact that big data can provide value in a wide variety of fields. SAS 5 has added two additional dimensions to complement the original three Vs. These are variability and complexity. IBM, includes a fourth V; veracity. Furthermore, a fifth V, value is commonly associated with big data. Principal analyst for O'Reilly Radar, Edd Dumbill, has given alternative definition [Dumbill, 12]: Big data is data that exceeds the processing capacity of conventional database systems. The data is too big, moves too fast, or doesn t fit the strictures of your database architectures. To gain value from this data, you must choose an alternative way to process it. In other words, there is no consensus on the exact characteristics of big data. Nevertheless there are multiple characteristics which most of the vendors in the field agree upon. From these definitions, we can describe big data as: Using big volume, big velocity, big variety data asset to extract value (insight and knowledge), further confirm veracity (quality and trustworthiness) of the original data and the acquired information, that demand cost-effective, novel forms of data and information processing for enhanced insight, decision making, and processes control. Additionally, those demands are supported by new data models and new infrastructure services and tools which are able to procure and process data from a variety of sources and deliver data in a variety of forms to several data and information consumers and devices. 2. Big Data in Industry Big data is transforming the industry landscape, as enterprises tap into more and more broad varieties of structured and unstructured data with greater speed and complexity. Business has always wanted to derive insights from information in order to 4 5
6 Analytics on Big Data using Real Time Data Processing 121 make better, smarter, real time, fact-based decisions: it is this demand for depth of knowledge that has stimulated the growth of big data tools and platforms. The leading enterprises are now including big data from both within and outside the enterprise, incorporating structured and unstructured data, machine data, and online and mobile data to supplement their organizational data and offer the basis for historical and forward-looking views. Enterprises that invest in and effectively derive value from their data will have a clear advantage over their competitors a performance gap that will continue to grow as more relevant data is produced, emerging technologies and digital channels offer better acquisition and delivery mechanisms, and the technologies that enable faster, easier data analysis continue to develop. Mostly business environment changes frequently and rapidly. Thus, in such environment, future prediction becomes more vital than the modest visualization of historical or contemporary perspectives. For effective future prediction, data analysis using machine learning and predictive modelling techniques may be applied to enhance and support the organization s business strategy [Akerkar, 13]. The gathering and aggregation of big data, and other information from outside the enterprise, enables the business to develop their own analytic capacity and capability, which for many years has only been available to a few larger organizations. The aviation industry encompasses a huge amount of data, and many airlines and airports cannot manage and process the amount of data they receive, but such data could be used to revolutionise the passenger experience. The vast amount of data produced related to passenger flow, cost reduction and revenue enhancement is too much to handle for most small airline IT departments. Data-driven marketing can provide insights from data in real-time so there can be consistent understanding of passenger behaviours. From recent Accenture 6 study, big data analytics has become the highest priority for aviation (61%), wind (45%) & manufacturing (42%) companies. The following graphic provides insights into the relative level of importance of big data analytics relative to other priorities in the enterprises interviewed in the study: Figure 1 Data analytics priorities in industry 5 6
7 122 Rajendra Akerkar With 35 million flight departures per year, data is critically important for any planning decision made by airlines and airports. In an example used by Josh Marks, the aviation industry needs to begin documenting and utilising data in a way similar to the online retailer, Amazon. Amazon manufactures product suggestions based on its customer s previous activity. They collate data about customer s previous purchases, as well as previously viewed items, and even mouse movement on the webpage. These predictive analytics allow them to target customer s needs effectively and with profitability. This sort of data collection could effectively be utilised in the aviation industry, particularly with airline websites with regards to booking and transactional data sets. There are $140 million worth of ticket transactions made through airline ticketing websites- and this figure is not inclusive of booking sites such as Expedia. The current look to book ratio stands at approximately 10:1, signifying that customers will view approximately ten booking websites before making a final decision. However, airlines do no track this sort of data, only their transactional data, therefore missing out a huge chunk of possible marketing opportunities. Tracking the time and place a customer booked from, fares offered from other websites, and customers IP addresses would allow airlines a greater insight into its customer needs. Probably most importantly, it would allow airlines the opportunity to see if a customer searched for a route it does not offer - this sort of information is fundamental in route development. It is not just traditional businesses which are harnessing the value of data. Over the last two decades we have seen the rise of a new industry, whose main asset is data. Armed with vast amounts of data and affordable capabilities for storage and processing, companies have been able to create new business and revenue streams from selling data or delivering services that are based on data analytics. The most prominent examples of new use of data occur in the new Internet-based industries. Here, companies exist that have created big business based entirely on access to data and their ability to use data. In addition to innovations in the business domain these companies have also moved big data technology forward by inventing and implemented the technology needed to solve the problems related to data handling and analyses in their own operations. Prime examples of such companies are Google, Facebook, Yahoo and Twitter. As mentioned earlier companies in sectors such as telecom, retail, media, healthcare, insurance, finance and transport/logistics are being transformed by utilizing large data sets about their customers and internal work processes. Insights from these data streams are used for better assessment of utilization, to improve operational efficiency, and to increase sales and the efficacy of marketing. For traditional producers of goods the main use of data will be to facilitate improvement in the quality of the end product and to make the overall process more cost-effective. Typically this results in an increasingly automated production process. The benefits of process optimization has of course has been recognised for industrialized processes for a long time, but access to new technology, the availability of data have made it possible to take this to take this to new levels of sophistication.
8 Analytics on Big Data using Real Time Data Processing 123 In contrast, businesses in the knowledge industry (consulting would be a prime example of this) the main product is helping customers in solving their problems, and the key assets are the knowledge and capabilities of its workers. The main changes, challenges and opportunities posed by big data in this industry are related to: changes in the competitive landscape, data handling capabilities expected by the customers, and go to market strategies for data driven services. New technical capabilities have the potential to increase the efficiency of project delivery, to facilitate reuse of data, and enable scaling, through automation of the delivered services. At the same time; the possibility of encoding knowledge into models and use these models in combination with data can also enable competition from new players and thus completely alter the competitive landscape. The advent of more use of sensor data and automated monitoring is the sign of the next wave of changes in business: The Internet of things (IoT). A future where an products and appliances not only are able to sense and act upon the environment but also exchange and act upon information and data shared by other devices (i.e. intelligent machine to machine communication). These technologies will certainly take automation to the next level and it will be crucial for future smart grid solutions in the power sector, and they will also generate large amounts of machine to machine interaction data which will be available across traditional barriers. The IoT trend will therefore open up new opportunities for advanced analytical offerings and services and this is the main rationale behind the large investments in IoT and analytics by companies like General Electric (GE) and Phillips. Another trend which plays into both commercial use of big data and IoT is the advent of a new generation of cognitive computing, like IBM s Watson technology, which is able to sift through, combine and infer knowledge form large collections of data sources 7. Internet of Things has replaced big data to be the most hyped technology as Gartner s Hype Cycle 8 for Emerging Technologies said. Things here can refer to uniquely identifiable embedded computing devices such as heart monitoring implants, smart thermostat systems, etc. Big data and Internet of Things together will help build valuable systems. The value of IoT will be in gaining timely, valuable insights from all of the data being generated by sensors, etc. The advent of the IoT does also drive development of big data technology, as an example of this ParStream s analytics database is a great fit for the speed and scale of IoT and is exactly the type of technology that can be the difference between big data and smart data driving business value. Mostly the discussion around big data has focused on clickstream data, sentiment analysis and consumer targeting. But behind the scenes, the capabilities enabled by machine-to-machine communication and advanced analytics stand poised to dramatically change the world around us. The Industrial Internet of Things (IIoT) is connecting the physical world of sensors, devices and machines with the Internet and, by applying deep 7 Disruptive technologies: Advances that will transform life, business, and the global economy, McKinsey white paper on disruptive technologies, 8
9 124 Rajendra Akerkar analytics through software, is turning massive data into powerful new insight and intelligence. The Industrial Internet involves putting different kinds of sensors, sometimes by the thousands, in machines and the places they work, then remotely monitoring performance to maximize profitability. G.E. 9, one of the world s biggest makers of equipment for power generation, aviation, health care, and oil and gas extraction, has been one of its biggest promoters. The development in IIoT will allow us to connect intelligent machines, advanced analytics and clever people working in smarter ways to achieve extraordinary things. And the fuel driving this revolution will be big data masses of information aggregated, analysed and put to work across sectors as diverse as energy, transport, aviation, healthcare, consumer goods, retail and even other professional services. The industrial internet promises great benefits. However it raises some sensitive legal and moral issues, which will become increasingly prominent as the use of data and analytics becomes more sophisticated. 3. Insights through Big Data Analysis Recent days the aviation industry adopts on Condition/Preventive maintenance procedures due to its operational efficiency and it depends upon the failure mode calculations made after testing a part under circumstances. These conditions may fluctuate depending on the external factors/human errors which may result in the variation in the life time of components in turn reducing the operational efficiency of the aircrafts. A study by FAA 10 states that during a year jet engine generates data equivalent to 20TB. Basically most of this data is not used for any of the analytics purpose since this data is unstructured. Big data analytics can be used to predict the fault in the component by analysing data obtained from various sensors and account of the specific component attached to an aircraft or fleet in which it is present. As we know most airlines collect lot of data for historical, archiving and compliance purpose. However, there are very few attempts towards acquiring the customer intelligence from the massive data sources. There is a clear need for drastic shift from conventional analysis to provide insight about the past & current state of business, to next generation systems deployed for predictive analytics of latent customer behaviour. In order to obtain such insight airline companies must utilise an integrated outlook of customer which covers different touch points and numerous data sources that may or may not reside within the company s ecosystem. For instance customer profiles, transaction details, social behaviour, complaints, psychographic data, techno graphic data etc. They would need cutting-edge big data ecosystem to make sense of such structured & unstructured data sets characterized by large volume, high velocity and great variety. In the following subsection, let us define some use cases
10 Analytics on Big Data using Real Time Data Processing Typical use cases 1. Assume that a pilot augments their decision making process with real time business intelligence, for instance, information available in the cockpit would allow them to make appropriate tunings to their flight patterns. The computational methods to better optimize flight paths so airlines can reduce cost, avoid bad weather, and get to their destinations on time. 2. Airlines produce enormous amounts of data during various processes such as online communication, online price comparison and ticket purchasing, online check-in and seat selection, personalization of offers, etc. Some airline companies use complex algorithms to collect and analyse the vast amounts of data that are generated in real-time by the sensors nowadays present on every plane. This is tapping into industrial internet. The sensors help airlines to monitor the planes in real-time, also when in flight, and manage and predict maintenance, spot problems before they happen, reduce fuel consumption and shorten turn-around-time at airports. 3. To understand customers better than its competitor, utilise the customer intelligence amassed across several touch-points. Exploit it to perform behavioural marketing, recommend products & services, personalize their offering for every customer in an enhanced manner, up-sell & cross-sell and develop new revenue stream altogether. For example, personalization can be like providing a different look and feel for distinct customers at home page of airlines website Generating key insights In this subsection we consider a case of an airline market competition. Figure 2 Bayesian network for passenger pattern
11 126 Rajendra Akerkar Until now most airlines have analysed partial datasets, which are thinned subsets of the big data. Thus the airline companies haven t been able to extract the broad understanding it was looking for. In order to extract important insights from the big data that would not be readily apparent from studying limited localised datasets, we have used tools such as R 11, Tableau 12 and BayesiaLab 13. A Bayesian network is flexible in dealing with sparse and incomplete datasets. By using Bayesian networks, big data technology and airline market knowledge, we have carried out computation to explore the big data repository and to visualise the results. Bayesian maps are used in supplying the missing information and details as well as bringing the priorities and importance of the effective factors. In comparison to other casual maps, Bayesian maps use Bayes theory to find the certainty factors on the interaction of decision variables. Bayesian network is applicable when historical data is available and shows the major advantage on analysing complex unstable systems. We analysed large datasets containing one year of passenger data approximately 40 gigabytes. The outcome from mining the data included inferences about airline performance, market traits and passenger booking patterns as shown in Figure 2. We generated hypothesis to test from the data, such as: can predictive modelling be developed to evaluate routes for reservation changes, and to schedule profitability for prospective expansions? More cases and detailed results will be presented in extended version of this paper. 4. Conclusion With the advent of the big data era, dealing with large amounts of data is challenging. Big data can help operations for airline companies and airports to reduce redundant variability. The airlines of the future will be defined by the ability to obtain & process the enormous amount of customer data to gain insight at a speed surpassing the pace at which customer behavior and business environment might change. Using the data furnished, airlines can offer a personalized incentive for every type of customer resulting in more auxiliary sales, greater percentages of repeat business, and better customer allegiance. Further it can help the relationship between airports and airline companies in the operational sense, and help build knowledge about demographics. References Akerkar, R. A. (2013) Big Data Computing. CRC Press. Akerkar, R. A.; Lingras, P. (2008). An Intelligent Web: Theory and Practice, 1st edn. Johns and Bartlett, Boston. Armour, F. (2012) Introduction to big data, presentation at the symposium Big Data and Business Analytics: Defining a Framework, Center for IT and Global Economy, Kogod School of Business, American University, Washington, DC. Bell, G., Hey, T., Szalay, A. (2009) Beyond the data deluge, Science 323 (5919),
12 Analytics on Big Data using Real Time Data Processing 127 Boland, D., Morrison, D., and O Neill, S. The future of CRM in the airline industry: A new paradigm for customer management. IBM Institute for Business Value. 05.ibm.com/innovation/nl/pdf/highlights/integration/crm_airline.pdf Diebold, F.X. (2000). Big data dynamic factor models for macroeconomic measurement and forecasting. Discussion read to the 8th World Congress of the Econometric Society, Seattle, August. Dumbill, E. (2012) Making sense of big data. DOI: /big Gualtieri, M., The pragmatic definition of big data. Forrester Research Blog. John-Paul Clarke. (2013) Enabling Pro-Active Decisions via Predictive Analytics. Air Transport IT Summit. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari. (2010) S4: Distributed Stream Computing Platform, in Proceedings of IEEE International Conference on Data Mining Workshops (ICDMW), pp Laney, D. (2001) 3d Data management: controlling data volume, velocity and variety, Appl. Delivery Strategies Meta Group (949). Lynch, C. (2008) Big data: how do your data grow?. Nature 455 (7209), Mark van Rijmenam. (2014) Southwest Airlines Uses Big Data To Deliver Excellent Customer Service. Datafloq blog. https://datafloq.com/read/southwest-airlines-uses-big-data-deliverexcellent/371 McKinsey Global Institute. (May 2011) Big data: The next frontier for innovation, competition, and productivity. Nathan Marz and James Warren. (2012) Big Data- Principles and best practices of scalable realtime data systems. Manning publishing. Savitz, E. (2012) Gartner: 10 Critical Tech Trends for the Next Five Years. Savitz, E. (2012) Gartner: Top 10 Strategic Technology Trends for Smith, J.A. (2012) Field Note: What Makes Big Data Big Some Mathematics Behind Its Quantification, Data Scientist Insights. Szalay, A., Gray, J. (2006) Science in an exponential world, Nature 440, TechAmerica Foundation. (2012) Demystifying Big Data. Washington, DC. Zikopoulos, P. Chris, E. (2011) Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data, McGraw Hill Professional.
Survey Results Table of Contents Survey Results... 4 Big Data Company Strategy... 6 Big Data Business Drivers and Benefits Received... 8 Big Data Integration... 10 Big Data Implementation Challenges...
BIG DATA FUNDAMENTALS Timeframe Minimum of 30 hours Use the concepts of volume, velocity, variety, veracity and value to define big data Learning outcomes Critically evaluate the need for big data management
Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013 Housekeeping 1. Any questions coming out of today s presentation can be discussed in the bar this evening 2. OCF is
Understanding the impact of the connected revolution Vodafone Power to you 02 Introduction With competitive pressures intensifying and the pace of innovation accelerating, recognising key trends, understanding
Research Note What is Big Data? By: Devin Luco Copyright 2012, ASA Institute for Risk & Innovation Keywords: Big Data, Database Management, Data Variety, Data Velocity, Data Volume, Structured Data, Unstructured
Why Modern B2B Marketers Need Predictive Marketing Sponsored by www.raabassociatesinc.com firstname.lastname@example.org www.mintigo.com email@example.com Introduction Marketers have used predictive modeling
www.pwc.com Game On: How Information is Changing the Rules of Insurance Game On: How Information is Changing the Rules of Insurance The ability to extract meaningful insights from information assets is
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
Cloud Analytics Where CFOs, CMOs and CIOs Need to Move To IN PARTNERSHIP WITH Analytics and the Speed Advantage Introduction Three recent workplace trends the growth of the mobile revolution, the emergence
BUY BIG DATA IN RETAIL Table of contents What is Big Data?... How Data Science creates value in Retail... Best practices for Retail. Case studies... 3 7 11 1. Social listening... 2. Cross-selling... 3.
EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed
Community Driven Apache Hadoop Apache Hadoop Patterns of Use April 2013 2013 Hortonworks Inc. http://www.hortonworks.com Big Data: Apache Hadoop Use Distilled There certainly is no shortage of hype when
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and
ANALYTICS BUILT FOR INTERNET OF THINGS Big Data Reporting is Out, Actionable Insights are In In recent years, it has become clear that data in itself has little relevance, it is the analysis of it that
White Paper Analyzing Big Data: The Path to Competitive Advantage by Marcia Kaplan Contents Introduction....2 How Big is Big Data?................................................................................
www.pwc.co.uk/technology Introduction to Big Data How a buzzword morphed into a lasting trend that will transform the way you do business May 2014 Your competitors may already be staking out first mover
Harnessing Big Data to Improve Customer Service By Marty Tibbitts The goal is to apply analytics methods that move beyond customer satisfaction to nurturing customer loyalty by more deeply understanding
BIG DATA - How big data transforms our world Kim Escherich Executive Innovation Architect, IBM Global Business Services 1 2 What happens? What is data? 340.282.366.920.938.463.463.374.607.431.768.211.456
Business Analytics and the Nexus of Information 2 The Impact of the Nexus of Forces 4 From the Gartner Files: Information and the Nexus of Forces: Delivering and Analyzing Data 6 About IBM Business Analytics
SAP Brief SAP Technology SAP Sybase IQ Objectives Tap into Big Data at the Speed of Business A simpler, more affordable approach to Big Data analytics A simpler, more affordable approach to Big Data analytics
Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize
Hadoop for Enterprises: Overcoming the Major Challenges Introduction to Big Data Big Data are information assets that are high volume, velocity, and variety. Big Data demands cost-effective, innovative
Airline Applications of Business Intelligence Systems Mihai ANDRONIE* *Corresponding author Spiru Haret University Str. Ion Ghica 13, Bucharest 030045, Romania firstname.lastname@example.org DOI: 10.13111/2066-8201.2015.7.3.14
white paper Big Data for Small Business Why small to medium enterprises need to know about Big Data and how to manage it Sponsored by: Big Data is the ability to collect information from diverse sources
Global Technology Outlook 2011 Global Technology Outlook 2011 Since 1982, The Global Technology Outlook had identified significant technology trends five to even 10 years before they have come to realization.
Data Visualization & Applications of Big Data in various sectors Soumya Jha, Nikhil Kumar Agrawal Abstract Big data is a term for massive data sets having large, varied and complex structure with the difficulties
Big Data a threat or a chance? Helwig Hauser University of Bergen, Dept. of Informatics Big Data What is Big Data? well, lots of data, right? we come back to this in a moment. certainly, a buzz-word but
SCALEOUT SOFTWARE How In-Memory Data Grids Can Analyze Fast-Changing Data in Real Time by Dr. William Bain and Dr. Mikhail Sobolev, ScaleOut Software, Inc. 2012 ScaleOut Software, Inc. 12/27/2012 T wenty-first
Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require
Why is BIG Data Important? March 2012 1 Why is BIG Data Important? A Navint Partners White Paper May 2012 Why is BIG Data Important? March 2012 2 What is Big Data? Big data is a term that refers to data
Bringing Together ESB and Big Data Bringing Together ESB and Big Data Table of Contents Why ESB and Big Data?...3 Exploring the Promise of Big Data and ESB... 4 Moving Forward With ESB and Big Data...5
5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK CUSTOMER JOURNEY Technology is radically transforming the customer journey. Today s customers are more empowered and connected
Industrial Internet @GE Dr. Stefan Bungart The vision is clear The real opportunity for change surpassing the magnitude of the consumer Internet is the Industrial Internet, an open, global network that
WHITEPAPER BEST PRACTICES Releasing the Value Within the Industrial Internet of Things Executive Summary Consumers are very familiar with the Internet of Things, ranging from activity trackers to smart
HOW BIG DATA IS IMPROVING MANAGEMENT Ciklum 2002-2015 All rights reserved 1 www.ciklum.com INNOVATIONS IN BIG DATA ARE NOW MAKING IT POSSIBLE FOR SMART MANAGEMENT EXECUTIVES IN VARIOUS INDUSTRIES TO INCREASE
White Paper IT Workload Automation: Control Big Data Management Costs with Cisco Tidal Enterprise Scheduler What You Will Learn Big data environments are pushing the performance limits of business processing
Big Data, Physics, and the Industrial Internet! How Modeling & Analytics are Making the World Work Better." Matt Denesuk! Chief Data Science Officer! GE Software! October 2014! Imagination at work. Contact:
India Chapter, Bangalore Big Data Analytics & Electronics System Design Ankan Mitra Vice-President SMTA India Chapter Hello Bangalore, How do you do? SMTA India Chapter ಹಲ ಬ ಗಳ ರ ನ ವ ಹ ಗ ದ ದ ರ? హల బ గళ
INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A SURVEY ON BIG DATA ISSUES AMRINDER KAUR Assistant Professor, Department of Computer
BIG Data An Introductory Overview IT & Business Management Solutions What is Big Data? Having been a dominating industry buzzword for the past few years, there is no contesting that Big Data is attracting
III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution
Judith Hurwitz President and CEO Sponsored by Hitachi Introduction Only a few years ago, the greatest concern for businesses was being able to link traditional IT with the requirements of business units.
DEVELOP INSIGHT DRIVEN CUSTOMER EXPERIENCES USING BIG DATA AND ADAVANCED ANALYTICS by Dave Nash and Mazen Ghalayini; Contributions by Valentin Grasparil This whitepaper is the second in a 3-part series
White Paper Business Networks: The Next Wave of Innovation Sponsored by: Ariba Michael Fauscette November 2014 In This White Paper The business network is forming a new framework for productivity and value
SAP Brief SAP HANA Objectives Transform Your Future with Better Business Insight Using Predictive Analytics Dealing with the new reality Dealing with the new reality Organizations like yours can identify
SAP Makes Big Data Real Real Time. Real Results. MAKE BIG DATA REAL WITH SAP SOLUTIONS: ACCELERATE. APPLY. ACHIEVE Accelerate, Apply, and Achieve Big Results from Your Big Data Big Data represents an opportunity
BIG DATA & SOCIAL INNOVATION KENNETH THOMAS, CLIENT MANAGER 1 MAKING THE RIGHT DECISSION AT THE RIGHT PLACE AT THE RIGHT TIME 2 THE DATA MULTIPLIER EFFECT AT WORK BUSINESS DRIVEN HUMAN DRIVEN MACHINE DRIVEN
Big Data overview SICS Software week, Sept 23-25 Cloud and Big Data Day Livio Ventura Big Data European Industry Leader for Telco, Energy and Utilities and Digital Media Agenda some data on Data Big Data
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government
THE STATE OF Customer Analytics Taking A Proactive Approach To Loyalty & Retention By Kerry Doyle An Exclusive Research Report UBM TechWeb research conducted an online study of 339 marketing professionals
CRISIL Young Thought Leader 2012 VIRTUALIZATION, CLOUD, SOCIAL NETWORKING, BIG DATA Are these just buzzwords? What are the technologies that will change the business in future? Arun Koshy Thomas Second
7 Big Data: How can it enhance your strategy? Practice Area: IT Strategy Topic Area: Big Data Connecting the data dots for better strategic decisions Data is essential for organisations looking for answers
ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: email@example.com
Business Intelligence solutions decisions that are better-informed leading to long-term competitive advantage Your business technologists. Powering progress Every organization generates vast amounts of
DATA MANAGEMENT FOR THE INTERNET OF THINGS February, 2015 Peter Krensky, Research Analyst, Analytics & Business Intelligence Report Highlights p2 p4 p6 p7 Data challenges Managing data at the edge Time
www.pwc.com/us/bigdata Capitalizing on the promise of Big Data How a buzzword morphed into a lasting trend that will transform the way you do business January 2013 Your competitors may already be staking
white paper Business Intelligence and Big Data Analytics: Speeding the Cycle from Insights to Action Four Steps to More Profitable Customer Engagement»» Summary For business intelligence analysts the era
Insightful Analytics: Leveraging the data explosion for business optimisation 09 Top Ten Challenges for Investment Banks 2015 Insightful Analytics: Leveraging the data explosion for business optimisation
Machina Research Where is the value in IoT? IoT data and analytics may have an answer Emil Berthelsen, Principal Analyst April 28, 2016 About Machina Research Machina Research is the world s leading provider
Population Analytics Population Analytics: A New Opportunity for Mobile Operators Few new mobile-based technologies have the potential to change the way that organisations think about their customers and
Customer Segmentation in the Age of Big Data By: Michael Million Moving Beyond Traditional Segmentation Traditional customer segmentation is at the heart of every marketing organization, giving companies
SEPTEMBER 2013 Buyer s Guide to Big Data Integration Sponsored by Contents Introduction 1 Challenges of Big Data Integration: New and Old 1 What You Need for Big Data Integration 3 Preferred Technology
9 8 TRENDS IN THE DEVELOPMENT OF BUSINESS INTELLIGENCE SYSTEMS Assist. Prof. Latinka Todoranova Econ Lit C 810 Information technology is a highly dynamic field of research. As part of it, business intelligence
Technology Insight Paper Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities By John Webster February 2015 Enabling you to make the best technology decisions Enabling
Brochure More information from http://www.researchandmarkets.com/reports/3276778/ Streaming Analytics Market by Verticals - Worldwide Market Forecast & Analysis (2015-2020) Description: Streaming Analytics
Why your business decisions still rely more on gut feel than data driven insights. THERE ARE BIG PROMISES FROM BIG DATA, BUT FEW ARE CONNECTING INSIGHTS TO HIGH CONFIDENCE DECISION-MAKING 85% of Business
Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data. 1 Advances in information technologies are transforming the fabric of our society and data represent
mwd a d v i s o r s Turning Big Data into Big Insights Helena Schwenk A special report prepared for Actuate May 2013 This report is the fourth in a series and focuses principally on explaining what s needed
International Journal of Advances in Engineering Science and Technology 221 Available online at www.ijaestonline.com ISSN: 2319-1120 Big Data Introduction, Importance and Current Perspective of Challenges
Big Data Management and Predictive Analytics as-a-service for the Retail Industry Serendio Predictive Analytics for the Retail Industry 2 Executive Summary The biggest and most successful retailers today,
A Strategic Approach to Unlock the Opportunities from Big Data Yue Pan, Chief Scientist for Information Management and Healthcare IBM Research - China [contacts: firstname.lastname@example.org ] Big Data or Big Illusion?
$ BIG DATA IN BANKING Table of contents What is Big Data?... How data science creates value in Banking... Best practices for Banking. Case studies... 3 7 10 1. Fraud detection... 2. Contact center efficiency
IBM Global Business Services Microsoft Dynamics CRM solutions from IBM Power your productivity 2 Microsoft Dynamics CRM solutions from IBM Highlights Win more deals by spending more time on selling and
Siemens Future Forum @ HANNOVER MESSE 2014 From Big to Smart Hannover Messe 2014 The Evolution of Big Digital data ~ 1960 warehousing ~1986 ~1993 Big data analytics Mining ~2015 Stream processing Digital
Cloud Computing on a Smarter Planet Smarter Computing 2 Cloud Computing on a Smarter Planet As our planet gets smarter more instrumented, interconnected and intelligent the underlying infrastructure needs
Advanced Analytics The Way Forward for Businesses Dr. Sujatha R Upadhyaya Nov 2009 Advanced Analytics Adding Value to Every Business In this tough and competitive market, businesses are fighting to gain
What happens when Big Data and Master Data come together? Jeremy Pritchard Master Data Management fgdd 1 What is Master Data? Master data is data that is shared by multiple computer systems. The Information
FIVE INDUSTRIES Where Big Data Is Making a Difference To understand how Big Data can transform businesses, we have to understand its nature. Although there are numerous definitions of Big Data, many will
Transforming Data into Intelligence Scalable Enterprise Data Integration Your business agility depends on how fast you can access your complex data Big Data Data Warehousing Data Governance and Quality
White Paper Data Virtualization: Achieve Better Business Outcomes, Faster What You Will Learn Over the past decade, businesses have made tremendous investments in information capture, storage, and analysis.