Big Data Architectures. Tom Cahill, Vice President Worldwide Channels, Jaspersoft

Transcription

1 Big Data Architectures Tom Cahill, Vice President Worldwide Channels, Jaspersoft

2 Jaspersoft + Big Data = Fast Insights Success in the Big Data era is more than about size. It s about getting insight from these huge data sets more quickly Doug Henschen InformationWeek 2012 Jaspersoft Corporation. Proprietary and Confidential 2

3 Big Data Large data sets, growing too big for conventional DBMS tools Where? Science (meteorology, genomics, connectomics, complex physics simulations, biological environmental research) Industry / government (information-sensing devices, aerial sensory technologies (remote sensing), software logs, cameras, microphones, radio-frequency identification readers (RFID), and wireless sensor networks Consumers / consumer-related (social networks, social data, internet text and documents, internet search indexing, call detail records, web logs, medical records, photography archives, video archives 2012 Jaspersoft Corporation. Proprietary and Confidential 3

4 Challenges Managing capture, storage, search, sharing, analytics and visualization Validity relevance, value, interpretation and time Who younger, consumer-type decision-makers, self-service expectations, ubiquity of access (mobile), simplicity of use, elegance of design 2012 Jaspersoft Corporation. Proprietary and Confidential 4

5 More definitions Hadoop (Apache) A framework to support distributed applications Enables applications to work with many (many) independent computers and lots (lots) of data Derived from Google MapReduce Free, OS with a number of commercial offerings (IBM, Greenplum, Cloudera etc) MapReduce Google patent Interface too low-level for today s needs in big data? Recent Hadoop and HBase developments move the story forward 2012 Jaspersoft Corporation. Proprietary and Confidential 5

6 More definitions Contd Hbase Non-relational, distributed database Adding BigTable capabilities to Hadoop Also OS Hive Data Warehouse built on Hadoop Originally developed by Facebook; now used by eg Netflix Included on Amazon Web Services 2012 Jaspersoft Corporation. Proprietary and Confidential 6

7 Jaspersoft Leading BI for Big Data Most Comprehensive Big Data support Partnerships Access methods Connectors 2012 Jaspersoft Corporation. Proprietary and Confidential 7

8 Big Data Partnerships Hadoop NoSQL/NewSQL Analytic DBMS 2012 Jaspersoft Corporation. Proprietary and Confidential

9 Big Data Access Methods Support for batch oriented reporting & analysis HIVE or standard JDBC interface ETL or ELT out of Hadoop into RDBMS for analysis/reporting Formatted layout, delivered daily, weekly, monthly, etc. Support for interactive reporting & analysis Uses native interfaces to HBase, MongoDB, etc. Ideal for data exploration Low-latency speed of thought queries Presented via intuitive Ad Hoc Analysis UI for broader appeal & adoption Unified Analysis Interface supports relational, OLAP, and Big Data source exploration 2012 Jaspersoft Corporation. Proprietary and Confidential 9

10 3 Approaches to Big Data Analysis Approach Interactive Exploration Direct Batch Reporting Indirect Batch Analysis Use Case For data analysts and data scientists who want to discover real-time patterns as they emerge from their Big Data content For executives and operational managers who want summarized, pre-built daily reports on Big Data content For data analysts and operational managers who want to analyze historical trends based upon pre-defined questions in their Big Data content Latency Low Medium High Big Data HBase, NoSQL, Analytic DBMS Hive, NoSQL, Analytic DBMS Hadoop, NoSQL, Analytic DBMS Connectivity Native Native, SQL ETL Architecture Multi-Dimensional Analysis Reports & Dashboards Multi-Dimensional Analysis In-Memory Engine OLAP Engine BI Platform BI Platform BI Platform Native Native SQL BIG DATA BIG DATA Data Mart ETL BIG DATA Jaspersoft Corporation. Proprietary and Confidential

11 Technical Details of Big Data Connectors HBase example Direct, native connectivity to HBase Using a JSON-like query language Supports all of HBase filter APIs StartRow, EndRow, RowFilter, FamilyFilter, ValueFilter etc. Can specify exactly the ColumnFamilies and/or Qualifiers returned Contains a deserialization (SerDe) engine framework Users can plug in their own deserialization.jars Converts HBase raw bytes into meaningful data types Optimized performance 2012 Jaspersoft Corporation. Proprietary and Confidential 11

12 Big Data Connectors Cassandra CouchDB EhCache GemFire Hadoop Avro Hadoop HBase Hadoop Hive MarkLogic Membase MongoDb Neo4j Redis Solr SpringData Redis VoltDb 2012 Jaspersoft Corporation. Proprietary and Confidential 12

13 Trends in Big Data Sources 2012 Jaspersoft Corporation. Proprietary and Confidential 13

14 ABOUT JASPERSOFT 2012 Jaspersoft Corporation. Proprietary and Confidential 14

15 Quick Jaspersoft Company Data 50%-60% Growth FY 09 FY 12 Year-over-Year sales growth Recognized by industry analysts and journalists: Magic Quadrants More than 40 global partners including:

16 Jaspersoft Community Every Minute 6 product downloads Every Day 250 new community members 30,000 users building BI apps Every Month Worldwide Adoption Over 15 million product downloads Over 14,000 Commercial Customers Over 1,000 Software Subscribers 175,000 production deployments 250,000 registered community members 250 New Customers 2012 Jaspersoft Corporation. Proprietary and Confidential 16

17 Jaspersoft Customers 250,000 Community. 175,000 Production Deployments. 14,000 Customers. Software & Technology Public Sector Healthcare/Pharmaceutical Travel & Transportation Financial Services Telecommunications Manufacturing 2012 Jaspersoft Corporation. Proprietary and Confidential 17

18 Jaspersoft Big Data Customers Customer Description Connecting to Hadoop Using Jaspersoft withmongodb connector Connection to Hapoop Hive 2012 Jaspersoft Corporation. Proprietary and Confidential

19 A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native and browser-based mobile business intelligence New prospects see the dashboards, the drag-and-drop ad hoc query, and aesthetics, and say: Wow. We didn t know you guys could do this. And it s getting us new business lots of it. Bruce Belvin, President 2012 Jaspersoft Corporation. Proprietary and Confidential 19

20 A Flexible End-to-End BI Suite Easy to deploy standalone or embedded Easy to deploy on-premises or in the cloud Easy to customize or extend and include any data source 100% Web-Standards Architecture Presentation (.css) Events (.js) Structure (.jsp) Business Logic (.java) Extensive APIs It s all standards-based and we were able to apply the skills we had developed elsewhere. It was very easy for us to absorb the Jaspersoft technology into our system architecture Jeremy Walters, Director, Systems Development 2012 Jaspersoft Corporation. Proprietary and Confidential 20

21 An Affordable End-to-End BI Suite Affordable commercial open source subscription Fast, low-cost implementations Cost-effective support, commercial or community Because we wanted to be able to grow and change as our needs evolved, we chose what we felt was the more future-proof platform. That and a very low cost of ownership made our choice fairly easy. John Sweet- Escott, Project Director Source: Third Nature, Lowering the Cost of Business Intelligence with Open Source Jaspersoft Corporation. Proprietary and Confidential 21

22 Try Out Jaspersoft Today Download Download 30-day Evaluation of Jaspersoft BI Enterprise at Jaspersoft.com Go to Jaspersoft.com/getting-started for setup tips On-Demand Trial Try our Live Online version NO INSTALLATION! Go to Jaspersoft.com/jaspersoft-live-trial Use for 7-days 2012 Jaspersoft Corporation.

23 Q & [email protected] France: openbookonbi.blogspot.com Brian Gentile CEO 2012 Jaspersoft Corporation.

24 Thank You