Optimized Hadoop for Enterprise

Transcription

1 Optimized Hadoop for Enterprise Smart Big data Platform provides Reliability, Security, and Ease of Use + Big Data, Valuable Resource for Forecasting the Future of Businesses + Offers integrated and end-to-end service with Advanced Analytics Solution, from Big Data collection to business implementation + LG CNS Advanced Analytics Solution is Producing Success Cases across Business Sectors

2 Introduction Led by Google, Amazon, Facebook and even Obama s presidential election strategy, now Big data became the core of IT extended to all managements. Enterprises and public organizations consider big data as one of the most important paradigm and begin to adapt big data platform to their business domains. Since huge amount of structured and unstructured data are pouring out from various industries, big data can be applied in countless fields. Global level enterprises use big to grasp idea of currents and quickly correspond to it. Big data also can be used to catch customer s needs and issues by collecting their real voices. Public industry is planning to introduce big data in different types of industries such as weather, safety, education and etc. Korea s first female president Geun-hye Park brought up so called the Creative Economics emphasizing big data is the core to solve high unemployment rate, which is one of the most serious issues in these days. She encourages enterprises, public organizations and individual to share the data to find useful information and create most value out of it. Hence, within a range that doesn t infringe on privacy, the way to open the data as much as possible to deliver more valuable information to people is continuously attempted. Even though data was open to each other, finding a meaningful insights and applying it to business is not simple at all. Integration of individual requirements, efficient data management and shared system configuration, and establishing big data clustering, all of these need to be considered. LG CNS is leading big data technology and business in Korea with outstanding in-house solutions including big data platform and vertical enterprise level solutions. Hence we could provide answers to some real business problems arise when enterprises adapted big data. 2

3 Big Data Platform Overview Big data analysis, analyzing large data in short amount of time to find insights from hidden information and knowledge, is now reflected in enterprise business innovation process and even in government policy. Since in most of times big data analysis is based on open source technology, customers face the practical problems such as a lack or shortage of technical support and management tools. Hence, they often hesitate from introducing big data system no matter how verified it is. LG CNS Smart Big Data Solution (SBP), developed at enterprise grade, can solve these problems. Key Success Factors 1. Introduce big data infra, Maintenance, Easy scalability, Efficiency 2. Big data operation, Easy to implement advanced analytic, Productivity 3. Enterprise grade management and security 4. Potential for development, flexibility and compatibility LG CNS Solution SBP Securing the reliable big data infrastructure with the proven technology and solutions via LG CNS Smart Big data Platform (SBP) is User-friendly (Convenient for development and management) - Able to develop by drag & drop and SQL without any Hadoop experience - Development and management on Web GUI based environment Efficient for Advanced Analytics - Easy development with web GUI based without script experience - Advanced analytics (ex) Machine Learning can be performed - With distributed environment, entire data can be utilized and possible to perform explorative analysis repeatedly One-stop Solution for Big Data - From Installation, Monitoring, Service management, Security management to business implementation 3

4 Reference Domestic leading Telco - User activity Analytics for contents recommendation and private assistant / Fraud detection for agency abuse Global leading display company - Factory/ Equipment Log Analysis Global leading electronics company - Financial analytics for management Global leading chemical industries company - Security log analytics Tips For customers who introduce big data for the first time, who have concerns about expensive management costs, who are struggling with long processing time, load and the limit of scalability or who have needs to analyze unstructured data etc. LG CNS provides you the ultimate solution, SBP. 4

5 Big Data Appliance Overview In considering big data platform, the end goal is to integrate your big data with your enterprise data to conduct advanced analytics on the data set. For this, complete, easy-to-deploy solution for acquiring and organizing big data is needed. Key Success Factors There are few important factors that need to be agreed with big data appliance. Maximized performance and stability guaranteed, short installation period with low cost and convenience of maintenance by optimizing S/W and H/W. LG CNS Solution Our SBP Appliance : SBP Appliance Guarantees outstanding performance and fast implementation with optimized S/W and H/W Specification SBP Appliance Full Rack (14 nodes) Starter Rack (7 nodes) In-Rack (3 nodes) / Full Rack (18 nodes) / Half Rack Expansions (9 nodes) Per Node : 2 x Eight-Core (2.6 GHz) 64 GB Memory 2 x 450GB SAS Disks : OS, 10 x [2TB, 3TB, 4TB] SATA Disks : Data Per Rack 2 x [4G, 10G] Switch Ethernet Administration Switch Integrated Solution RedHat Enterprise Linux 6.3 Smart Big data Platform(SBP) v1.5 - BigPack ( LGCNS Hadoop Standard Distribution - SCM (Service Cluster Manager) - MR Designer - User Portal - Data Collector R 5

6 Key Highlights Up to 10 times faster performance than legacy RDBMS queries Up to 70% data compression Lowest Price/Terabyte in the industry Reference Global leading chemical industries company - Product data analytic based reference implementation Tips SBP Appliance can benefit any customers who struggles from handling big data. Since the performance and stability are guaranteed, this will be of great worth to enterprises grade customers. Finally, LG CNS ensures a successful deployment with key consulting assistant and technical support. 6

7 Log Analysis Overview Currently, the field that big data the most needed is for log data analysis. Though, one of the largest amounts of data forms in log type, they were usually discarded or partially stored because of limited storage space and low performance. Of course, searching the data or trace analysis in real-time wasn t easily done either. However, as big data platform is introduced, huge amount of data can now be stored and analyzed guaranteeing low-cost and high-performance based on opensource. LG CNS Smart Log Analysis Platform (Smart LAP) not only delivers total process from collection, storage, process and analysis of log data but performs these procedures in real time. Key Success Factors 1. Easily scalable architecture with low-cost 2. High performance architecture that process massive amount of log data 3. Real-time supports from collecting log data to analysis 4. Flexible architecture to rapidly respond to log data and change in workspace. 5. Provides easy and convenient user interface Smart LAP Log analytics solution collects massive amount of log data in real-time and provides searching and monitoring function through indexing LG CNS Solution Our Smart Log Analysis Platform has 1. Solution based on big data platform : Store and process a large amount of log data with high performance 2. Real-time search and analytics : Detect and prevent problems in advance and investigate reasons of accidents very fast 3. Flexible and extensible architecture : Apply log format changes to searches and reports in real-time and to extend servers easily against the explosion of data 4. Easy and simple UI : Search logs and make reports by just click without complicated scripts and queries. 7

8 Reference Global leading electronics company - Service log analytics Global leading chemical industries company - Security log analytics Tips Smart LAP is useful for log analysis on massive data that couldn t be analyzed before due to storage or performance issue. Now, with Smart LAP, Service log analysis, Security log analysis, log analysis for IT operation management on big amount of data is easily done. Also, when real-time log search and tracing analysis is needed and when log entries change often leading the standard of log analysis needs to be changed flexibly, Smart LAP can benefit you. Finally, anyone can collect new logs and analyze them without experts. 8

9 Social Media Analytics Overview Rapid and wide spread of contents through social media is very attractive to enterprises but fearful at the same time. Enterprises are already aware of this and using them to communicate with end-customers. The biggest difference that determine the success and failure in these attempts is whether one has deep understanding of end-customers and mechanism of social media. LG CNS Smart SMA is a solution that collects online buzz while assuring accuracy of analysis to find business insights to help decision-making. Key Success Factors 1. Professional Staff : Organizational support by big data expert staffs 2. Document collection : Able to collect sufficient, adequate and accurate documents for each different industries 3. Analysis solution : Utilize Global no.1 analysis solution 4. Dashboard : Provides dashboard along business story line 5. Insight Report : Insight Report from data analysis experts 6. Issue Alert : Real-time issue detection Smart SMA Sense industry trends for current business by tracking customer responses to products, services or events and eventually help enterprises to correspond rapidly. LG CNS Solution Smart SMA service is focused on business. It gives officials an answer to business questions through specialized services and analysis skills costumed to each business domains. Not just reading off graphs and numbers but our solution understands the cause of events and provides insight to solve the problems. Smart SMA has the most rapid and accurate management system to make this possible. Beyond the system maintenance, entire service processes is managed to improve the accuracy of analyzed data. Reference Global Electronics Company Korea s leading banks Korea s leading industrial banks Korea s leading securities 9

10 Tips Smart SMA provides customized services for enterprise s business domains. With variety of service models that can be applied to many different domains such as Marketing, Promotion, Quality, Service etc. specialized solution and services are delivered. Not only B2C enterprises but B2B enterprises and even public agencies can use our solutions. 10

11 Fraud Detection System Overview Fraud occurs in various types through complex transactions both inside and outside of the enterprise. Because fraud inherently involves efforts at concealment, many fraud cases cannot be detected, and of those that are, it is more likely to be detected by a tip after the loss of asset. Hence, the needs of detecting fraud in advance has grown significantly among enterprises. Using SENA-FDS, the LG CNS fraud detection solution, unusual behavior and evidence can be detected by pattern analysis and visual pattern analytic methodology. Key Success Factors Respond to increasingly intelligent and sophisticated fraud, we need to satisfy few important factors; 1. Detecting unusual behaviors in short amount of time 2. Exploring and analyzing unusual behaviors from various types of data 3. Easy for collective management on suspicious groups 4. Minimize any loss or risks from any fraudulent activities 5. Optimized visualization for data exploration SENA-FDS Pattern analysis solution that detects unusual behavior and provide visualized pattern analysis methodology LG CNS Solution LG CNS SENA-FDS first provides you overview of the data to grasp some overall information. Then, through various Pattern analysis (ex) Comparison analysis, Self-comparison analysis etc. unusual information that follows abnormal pattern can be sorted out. Also, Suspicion analysis (ex)network analysis, Similarity check, Co-occurrence analysis etc. detects any suspicious behaviors to take a careful look. SENA-FDS is ready to use with built-in contents composed of 8 different scenarios and over 30 pattern analysis algorithms. Finally, after standard rules for efficient collective management are registered, detailed information of each subject from collective group is provided. 11

12 Reference Global Electronics Company - Service Warranty analysis Global Display Company - Security, Business management LG CNS - Internal Control Expense Tips SENA-FDS can be applied to customers who have needs to explore and analyze unusual behavior. With various analysis cases and algorithms, it is easily applied to business and its effectiveness can be measured in short time. Currently, it is developed on the basis of Oracle DBMS but will be extended to big data basis. Note that detected unusual behaviors not necessarily mean Fraud but meaning further analysis is needed on subjects following different pattern than others. 12

13 Recommendation System Overview As similar products and contents are pouring out these days, sorting out useful products is getting much burdened than before. Since so many choices are available to end-customers, enterprises are trying hard to attract them in different ways and this can be done by personalized recommendation. LG CNS SENA-Recommendation helps 1) enterprises to satisfy the customers by reading their preference and 2) endcustomers to make the best choice by providing personalized recommendation based on their purchase history. Key Success Factors To provide valuable information to customers, solution needs to satisfy; 1. Big data platform based analysis 2. Multiple analytic algorithms combined to optimize performance 3. Recommendation lists with reasons why recommended 4. Easy to interlock with other solutions (API provided) LG CNS Solution SENA-Recommendation Personalized Recommendation by Using Hybrid Algorithms based on Big Data Platform SENA-Recommendation is big data platform based recommendation solution which can process large amount of data in short time. Through self-developed hybrid recommendation algorithm with high hit ratio, reliable result is guaranteed. Also, providing analysis report on one s purchase history data and result analysis on recommendation give intuitive visualization making analyst s job much easier. SENA-Recommendation boosts up analyst s work efficiency and also the recommendation hit ratio. Refer Figure 1. on next page for SENA-Recommendation architecture. 13

14 Figure 1. SENA-Recommendation Architecture SENA-Recommendation Visualization Report Preliminary analysis report, Cross-category report, Purchasing cycle report etc. Personalized Recommendation List Optimal recommendation with high purchase probability Optimized Recommendation Algorithms Performance evaluation Machine Learning Cross category Analysis (Association Rule) Preference Analysis (Collaborative Filtering) Self-developed Algorithm Clustering Big data Platform Reference Korea leading Household & Healthcare Company - Personalized Recommendation Service Tips SENA-Recommendation can simply applied to anywhere in any business where customer s preference needs to be read. (Ex) music/movie contents, mobile content, Online shopping mall, Cosmetic companies and etc. In enterprise, it will be very useful for marketing purpose to sell their products that personally suit each customer s taste. 14

15 R Analytics SRA A statistical analysis tool optimized for big data based on open source R, allows advanced analytics with high performance and productivity Overview Analytics is to discover valuable information from the data. From point of business, the most important job is to find insights from the data for good decision-making and put it into action. As we enter big data era, now we need to extend our analysis on structured data from RDBMS to unstructured data like text-type and further to big data analysis saved in Hadoop. Key Success Factors Not only the traditional analysis but also many other valuable analysis using big data needs to be done; 1. Descriptive Analysis : Data Modeling, Visualization 2. Predictive Analysis : Data Mining, Predictive 3. Big Data Analysis : Full Data Analysis (from Hadoop) 4. Unstructured Data Analysis : Text Analysis 5. Visual Analysis : Self Service Analysis, Interactive Analysis LG CNS Solution SRA(Smart R Analytics) performs big data analytics on both structured and unstructured data with analytic engine based on open source R. This solution is optimized at Enterprise grade where it supports multiple server, multiple users and multiple sessions and has solution management tool. And these are some key features of SRA : Analytics of massive amount of data Interface to external system/application GUI based analysis/management tool Supports vertical analysis model (ex) Social Media Analysis, Fraud Detection, Quality Management etc. Text Analytics Reference Loaded on LG CNS Vertical Solutions - Fraud Analytics - Smart Contact Platform : VoC Analyze Tips Business users can easily perform data analysis using SRA. Also, it is a simple process for those of who want to apply analytic model made by data scientists to their business system. SRA is especially useful solution when there is high demand of big data analysis or text data analysis. 15

16 About LG CNS A GLOBAL CORPORATION TRUSTED BY CUSTOMERS ACROSS THE WORLD Since its establishment in 1948, LG Corporation has shaped the future of such industries as electronics, chemical, telecommunications, and service. Currently, more than 213,000 employees from 270 locations across the world are working hard to deliver innovative products and services to customers. LG Corporation also strives to become a respected global corporate citizen. BEST IT PARTNER FOR BUSINESS INNOVATION As a total IT service provider, LG CNS has delivered optimal IT solutions for more than 20 years since its establishment in Since then, we have successfully undertaken a wide range of IT projects for customers across industry sectors, including public, finance, manufacturing, and telecommunications, and acquired vast industry knowledge and advanced IT capacity. Based on our knowledge and technological capacities, we create differentiated smart technologies and lead business innovation at home and abroad. 7F, Prime Tower, #10-1, Hoehyeon-dong, 2-ga, Jung-gu, Seoul, , South Korea