DATA SHEET HGRID247 WORKFLOW DESIGNER

Transcription

1 DATA SHEET HGRID247 WORKFLOW DESIGNER SOLUSI247 logo are registered and HGrid247 logo are registered of of PT. Dua Empat Tujuh. SOLUSI247, therefore, reserves the right to change specifications without prior notice. Consult HGrid247 our representative for more information or contact Copyright 2016, SOLUSI247. All Rights Reserved

2 Nowadays, most transaction data is too big for traditional data warehousing. Therefore, social media platforms like Google, Amazon, Facebook and Zynga use the open source framework Hadoop to manage their data. In 2004 Google developed MapReduce to support their query engine. Yahoo started an Apache open source project to continue the development of MapReduce. Yahoo also created a distributed file system to support it, called Hadoop Distributed File System (HDFS). Rather than taking the conventional step of transporting data over a network to be processed by a program, MapReduce uses an approach that is tailor made for big data sets. MapReduce moves the program to the data instead of vice versa. Hadoop is now the mainstream Big Data solution. Many big vendors like Oracle, IBM, Teradata, HP and Microsoft have adopted and implemented this technology in their products. Hadoop can be implemented as a processing resource, as a storage system or both at the same time. It can be scaled up to an almost unlimited amount of nodes and easily processes peta bytes of data. Hadoop can store extremely large files and an enormous amount of files, more than can be stored on any particular node or server. Since Hadoop is quite complex to use, we have created a tool to make the Hadoop implementation in your organization much easier: HGrid247 Workflow Designer, part of the HGrid247 Big Data Solution. HGrid247 Big Data Solution is an experience based solution for Big Data. For over a decade we have worked on large scale processing of telecommunication transaction data. HGrid247 Workflow Designer generates MapReduce code and can be used with little or no coding experience. Highlights An improved approach to access your Big Data using the latest technology, Hadoop. HGrid247 makes it much easier to develop real world applications. HGrid247 is a Hadoop grid workflow designer created by SOLUSI247 with a ready to use ETL library. HGrid247 generates MapReduce code with limited or no coding experience.

3 HGrid247 Workflow Designer HGrid247 is a graphical user interface designer that will ease workflow design and implementation in Hadoop. It provides a comprehensive set of ETL functions, data preparation and a predictive modelling library. HGrid247 Workflow Designer is built on top of a cascading framework. Cascading was created in 2007 as a new Java API to implement functional programming for larger data workflows. Cascading is a pattern language for enterprise data workflows that is easy to build and test, and robust in production.

4 Benefits Develops and tests code from any development environment, including PC or Laptop. Easy deployment to various of Hadoop Distributions from several vendors, including Apache Vanilla, Cloudera, MapR, Hortonworks and YAVA Hadoop. Features Drag design and and Drop visualization workflow Ready Transformator, to use ETL Converter, library : Aggregator, Combiner, Join, Group by, Filter, Duplicate check Ready Pipe, Splitter, to use Buffer, workflow Merger, library: PMML, Check Point Sequence workflow Custom library editor Basic Library Statistic and Data Mining Source and Sink library: Hadoop file system, JDBC Executable generator MapReduce Audit log counter process Performance optimization Provides additional functions which are easily written and added as UDF in Java (simple and easy, no requirements to learn a new language or script) Helps organizations accelerate time to value by simplifying the complexity of big data implementation

5