Tungsten Replicator, more open than ever! MC Brown, Senior Product Line Manager September, 2015 2014 VMware Inc. All rights reserved.
We Face An Age Old Problem BRS/Search 2
It s Gotten Worse 3
Much Worse 4
Much Much Worse 5
Todays Challenge Multiple Types Transactional, Transient, Web Cache, Session Info, Analytical Multiple Formats Structured, Document based, ID based, Unstructured Multiple Sources Raw Inputs: Websites, applications, customers, users, IoT Stores: Transactional databases, NoSQL, Big Data, Analytical Stores, Message Queues Multiple Targets Transactional databases, NoSQL, Big Data, Analytical Stores, IoT, Message Queues Multiple Locations Different datacenters, different clouds, different cloud vendors 6
So What Do We Really Need? Efficient method for replicating data between systems Needs to be fast Needs to handle data format changes Needs to handle DDL and structure differences Needs to be heterogeneous Needs to handle flexible topologies Tungsten Replicator Does All This 7
Features at a Glance Tungsten Replicator 4.1 Apache 2.0 Licensed Same high-speed replication Low-latency, near real-time, active replication Provisioning Parallel Extraction Oracle With MySQL/automation tools DDL Translation Flexible filtering Filter schemas, tables, columns Filter by data Modify data JavaScript Filtering Easy to use batch applier Easy to use applier interface Multiple topologies Fan-out (scale-out) Fan-in Chaining Multiple targets Multiple sources 8
We Made Tungsten Replicator Open. Again. Tungsten Replicator is now Apache 2.0 Licensed! Fork the code from the VMware GitHub Page New community websites coming 9
VMware Continuent for Replication (Commercial) Based on Tungsten Replicator 4.1 VMware Continuent for Replication/Data warehouses Read from Oracle with a new extractor based on redo/archive log processing Read from MySQL Write to: Hadoop (all versions) Amazon Redshift HP Vertica MongoDB 24x7 Support Deployment Support Provisioning Low-latency active Replication 10
VMware Continuent for DR/Clustering (Commercial) MySQL Clustering Transparent connector proxy Read/write splitting and scaling DR Support, Cross Datacenter Support Continuent Connector Continuent Connector Continuent Connector Continuent Connector Asynchronous Primary-DR DB2.CA SECONDARY DB1.CA PRIMARY DB3.CA SECONDARY Asynchronous Multi-Primary CROSS-REGION REPLICATION DB2.NJ SECONDARY DB1.NJ PRIMARY DB3.NJ SECONDARY 11
We Want Your Help How? Tell Us What You Need Join the Community File bugs Fork the code on Github Fix bugs and send pull requests Write new features github.com/vmware/tungsten-replicator 12
What We Want To Do More appliers PostgreSQL, Microsoft SQL Server Data warehouses NoSQL Stores More Extractors PostgreSQL Microsoft SQL Server NoSQL Filters Make it Easier to Deploy Better encryption/compression Oracle HA using Continuent Clustering Support multiple deployment environments Effective hybrid cloud management Real-time data loading Real-time loading into analytics and data warehouses Replication for web front-end applications Reporting for data warehouses Suck/Push/Pull based replication Re-directional pipes Make replication between databases a service, not a chore Make replication transparent 13
Integration at VMware Continuent is driving a hybrid data model Validating Continuent solutions on VMs Simplified deployment through ready to run OVAs Improved networking across datacenters Expanding the integration between on-prem, VM, and public/private cloud deployments Expanding our supported operating systems to including Windows, Solaris (including SPARC), AIX Easing the way Tungsten Replicator is configured Integrating with vrealize and SRM for DR workloads 14
Get in Touch!! mcb@vmware.com 15