BIG DATA TOOLS. Top 10 open source technologies for Big Data

Transcription

1 BIG DATA TOOLS Top 10 open source technologies for Big Data

2 We are in an ever expanding marketplace!!! With shorter product lifecycles, evolving customer behavior and an economy that travels at the speed of light AND Information (which we now have more than enough access to) has gone on to be more about analytics and business relevance. SO WHAT DO YOU DO WITH YOUR GOLD MINE OF INSIGHTS? Happiest Minds presents TOP 10 open source technologies that are the best in the market to harness, analyze and make the most sense out of Big Data.

3 You simply can't talk about big data without mentioning Hadoop The Apache distributed data processing software is so pervasive that sometimes the terms "Hadoop" and "big data" get used synonymously Hadoop is known for the ability to process extremely large data in both structured and unstructured formats reliably replicating chunks of data to nodes in the cluster and making it available locally on the processing machine Apache Foundation also sponsors a number of related projects that extend the capabilities of big data Hadoop

4 If Hadoop is the big data mahout, MapReduce happens to be it s lifeline MapReduce was originally developed by Google! A programming model and software framework for writing applications, MapReduce works to rapidly process vast amounts of data in parallel on large clusters of compute nodes Widely used by Hadoop, as well as many other data processing applications

5 GridGain is a Java based middleware for faster in-memory processing of Big Data in real time GridGain offers an alternative to MapReduce GridGain is compatible with the Hadoop Distributed File System Requires Windows, Linux or Mac OS X operating system

6 Developed by LexisNexis Risk Solutions, HPCC is short for "high performance computing cluster" HPCC claims to offer superior performance to Hadoop HPCC Systems delivers on a single platform, a single architecture and a single programming language for data processing Both free community versions and paid enterprise versions are available

7 Coming from the Apache family, Storm is now owned by Twitter Storm differs from other tools with it s distributed, real-time, fault-tolerant processing system, unlike batch processing systems of Hadoop Real-time computation capabilities, it is fast and highly scalable, often being described as the "Hadoop of real-time" Fault-tolerant and works with nearly all programming languages, though typically Java is used

8 Cassandra is a highly scalable NoSQL database for massive data across multiple data centers and the cloud Originally developed by Facebook, it is now managed by the Apache Foundation Used by many organizations with large, active datasets, including Netflix, Twitter, Urban Airship, Constant Contact, Reddit, Cisco and Digg Its commercial support and services are available through third-party vendors

9 HBase is the non-relational data store for Hadoop Developed as part of the Apache Hadoop project, HBase runs on top of Hadoop Distributed Filesystem Being a column-oriented database management system, HBase is well suited for sparse data sets and is written in Java Supports writing applications such as Avro, REST and Thrift Features include: linear and modular scalability strictly consistent reads and writes automatic failover support and much more

10 MongoDB was originally developed by 10gen designed to support humongous databases mongodb literally comes from the term humongous and is the most popular NoSQL database system It's a NoSQL database written in C++ with document-oriented storage, full index support, replication and high availability and scales horizontally without compromising functionality Commercial support is available through 10gen

11 Neo4j boasts performance improvements of up to 1000x or more versus relational databases Developed by Neo Technologies, this is the world s leading graph database Stores data structured in graphs instead of tables and is a disk-based, fully transactional Java engine Organizations can purchase advanced and enterprise versions from Neo Technology

12 CouchDB stores data in JSON documents that can be accessed via the web or query using JavaScript Another one from the Apache Foundation, CouchDB is completely made for the web Offers distributed scaling with fault-tolerant storage Key featured include: On-the-fly document transformation Real-time change notifications Easy-to-use web administration console

13 About Happiest Minds Technologies Happiest Minds enables Digital Transformation for enterprises and technology providers by delivering seamless customer experience, business efficiency and actionable insights through an integrated set of disruptive technologies: big data analytics, internet of things, mobility, cloud, security, unified communications, etc. Happiest Minds offers domain centric solutions applying skills, IPs and functional expertise in IT Services, Product Engineering, Infrastructure Management and Security. These services have applicability across industry sectors such as retail, consumer packaged goods, e-commerce, banking, insurance, hi-tech, engineering R&D, manufacturing, automotive and travel/transportation/hospitality. Headquartered in Bangalore, India, Happiest Minds has operations in the US, UK, Singapore, Australia and has secured $ 52.5 million Series-A funding. Its investors are JPMorgan Private Equity Group, Intel Capital and Ashok Soota. For more information, visit Learn more about Big Data