MICROSTRATEGY ON AWS Presented by: MicroStrategy World 2015 Tuesday, January 27th 3:30 4:30 PM Track 8 Session 3 WWW.IOLAP.COM 1
INTRODUCTIONS iolap Data Warehousing and Business Intelligence consultancy MicroStrategy partner for 15 years Headquarters in Frisco, TX with national customer base 50+ U.S. employees and 25+ developers in Europe Nick Larsen Managing Partner 10 years at iolap MicroStrategy Architect AWS Architect WWW.IOLAP.COM 2
WHERE ARE YOU ON THE CLOUD JOURNEY? What s your current MicroStrategy infrastructure deployment? Evaluating Stealth IT closet Corporate data center Public data center Public Cloud (MicroStrategy/AWS/Azure/RackSpace/Other) Is your organization running anything in a public cloud? Who is currently an AWS customer? 70% Considering the cloud as primary platform for new analytics projects 10% Moving to cloud in next 2 years 61% On-premise analytics deployments by 2020 WWW.IOLAP.COM 3
PRESENTATION GOALS Provide an overview of Amazon Web Services products Describe AWS architectures that can benefit your data warehouse and BI platform Explore MicroStrategy deployment models in AWS and alternative use-cases Illustrate some experience differences of a cloud deployment Demonstrate an easy deployment of a disaster recovery scenario WWW.IOLAP.COM 4
CUSTOMER DEMANDS Harder. Better. Faster. Cheaper. Developers are like artists; they produce their best work if they have the freedom to do so, but they need good tools agility is a function of experimentation and fast failures. Werner Vogels CTO Amazon.com WWW.IOLAP.COM 5
KEY DW/BI AWS PRODUCTS Compute Storage Databases EC2 S3 Glacier RDS Redshift Workspaces Networking Data Processing VPC Direct Connect Route 53 EMR Kinesis Data Pipeline Cloud Formation WWW.IOLAP.COM 6
BIG PICTURE Workspaces Compute S3 Glacier EC2 corporate data center Data Processing Databases 3 rd Party Resources EMR Kinesis EC2 Data Pipeline RDS Redshift WWW.IOLAP.COM 7
NETWORK & SECURITY ARCHITECTURE WEB1 SUBNET1 us-east-1b ISERV1 SUBNET2 us-east-1 WEB2 ISERV2 SUBNET3 us-west-1a SUBNET4 us-west-1 WWW.IOLAP.COM 8
SCALING MICROSTRATEGY IP Distribution General Purpose T2: Development environments M3: Test and small production environments Compute Optimized C3/C4: Large general production Memory Optimized R3: High usage of Intelligence Cubes Data Warehouse http://aws.amazon.com/ec2/instance-types/ WWW.IOLAP.COM 9
EXAMPLE DEPLOYMENT INFRASTRUCTURE Create basic services with Cloud Formation EC2 RDS Redshift Note Internal IP addresses Attach an Elastic IP to the Web Server WWW.IOLAP.COM 10
MICROSTRATEGY AMI MicroStrategy offers a free 30 day trial in an easy to deploy Amazon Machine Image (AMI) from the AWS Marketplace. It includes 25 users and is deployed with SQL Server 2012 to handle the metadata repository. https://aws.amazon.com/marketplace/pp/b00jk1zek6/ Additional AMI s are available for 50, 100, 250, and 1000 users. Pricing is by the hour or annually plus EC2 usage, EBS storage, and data transfer fees. WWW.IOLAP.COM 11
USE CASES STARTING THE JOURNEY Temporary Environments 8.x 9.x Upgrades Easily upgrade your metadata and regression test against your primary environment using Integrity Manager Address issues in your AWS environment, upgrade your primary environment, and merge your changes back in POC Mobile deployments New applications Portal integrations WWW.IOLAP.COM 12
USE CASES GAINING TRACTION Secondary Environments Disaster Recovery Maintain an EBS snapshot of a MicroStrategy installation and have your CloudFormation scripts ready to go. When disaster strikes, create your environment and point it to your metadata or restore your latest metadata snapshot to RDS. Update DNS to point to AWS. Development Branches Keep you existing development and test environments separate from external labor or special project needs Dev/Test AWS is the perfect place for development and test environments Deploy Amazon Workspaces for client tools and forget about lost IServer connections WWW.IOLAP.COM 13
USE CASES ALMOST THERE Unique Requirements Seasonal Performance Additional hardware needs during certain time periods Cost effective pay only for what you use Geo Based Performance/Security Client connections must be routed to local data centers Reduce internet hops and latency WWW.IOLAP.COM 14
USE CASES ALL IN Temporary Environments Secondary Environments Unique Requirements Assimilate WWW.IOLAP.COM 15
CLOUD JOURNEY - EXAMPLE Starting the Journey POC ingesting vendor PO and store inventory data Tech: Redshift, DMX on EC2 Gaining Traction Integrate daily store databases Tech: Redshift, custom.net agent, S3, Python scripting on EC2, DMX on EC2 Almost There Integrate near real time store data Tech: Redshift, custom Java agent, S3, Python scripting All In Migrated all websites to EC2 Migrated all transactional databases to RDS Deployed multiple new applications that were previously outsourced WWW.IOLAP.COM 16
EXAMPLE DEPLOYMENT - CONFIGURATION Connection from Web to iserver Connection from iserver to Redshift Determine private IP of Metadata (RDS) Connection from iserver to Metadata (RDS) Start the iserver Connect Web to iserver WWW.IOLAP.COM 17
CONSIDERATIONS FOR A CLOUD DEPLOYMENT Location of Data Latency between data centers Security over network Data transfer costs Security AWS provides multiple layers AWS warns you of unsafe configurations Control You ve lost some of it Cost Management Monitor spending and adjust behaviors Purchase reserved instances BYOL vs. Marketplace Capital vs. expense Do the math Skillset A new kind of Architect may be needed WWW.IOLAP.COM 18
QUICK NOTE ON SECURITY Physical 24/7 trained security guards Electronic surveillance and multi-factor access control Other Features SSL/TLS encrypted endpoints Security groups (firewalls) User management via IAM Private subnets via VPC Encrypted data storage Security logs Identification and configuration Sharing the Responsibility With Infrastructure services, you own: Patching the OS Securing software Securing the security group With Platform services: AWS patches the OS You secure access to the service WWW.IOLAP.COM 19
WHAT S NEXT As experts in Data Warehousing, Business Intelligence, and Cloud Architecture, iolap is uniquely positioned to help you move through your cloud journey. Services include: Cloud ready assessment Custom cloud architecture planning Cloud POC or Pilot Cloud migration Managed cloud service www.iolap.com 214.618.5206 sales@iolap.com Frisco, TX, USA Rijeka, Croatia WWW.IOLAP.COM 20
QUESTIONS? Nick Larsen nlarsen@iolap.com T (214) 618-5215 C (214) 223-4722 THANK YOU WWW.IOLAP.COM 21