Windows Azure Realized

Transcription

1 Windows Azure Realized Steffen Vorein Lead Technologist, Cloud Strategy& Windows Azure Avanade Inc, Global Technologies and Solutions Copyright 2009 Avanade Inc. All Rights Reserved. The Avanade name and logo are registered trademarks in the US and other countries. 1

3 Challenges Perceived Risk of New Platform Lack of Developer Expertise in Tools and Patterns Compute Elasticity & Load Management Identity & Access Management Performance Monitoring and Management Data Security Concerns and Regulations Copyright 2009 Avanade Inc. All Rights Reserved. 3

6 Elasticity Runtime cost management becomes part of the architecture No instant-on for new instances Can take up to 60 to spin-up new instances Spin-up instances in advance if burst expected Could be on schedule (every Monday morning 8pm, etc.) No shutdown of a specific instance Makes downscaling difficult with long running processes Role instances are billed per partial wall clock hour Keep instances alive until shortly before a full hour ends Keep a spare instance running 2+ instances required for SLA Instances are distributed in upgrade groups which get upgraded sequentially Copyright 2009 Avanade Inc. All Rights Reserved. 6

7 Load Distribution Variable number of compute instances Unlike a grid where fixed set of resources is available Key factors for a batch style application Queue Length Number of items in queue Estimated workload (per item) Average throughput per instance Maximum allowed processing time Minimum/Maximum number of instances Copyright 2009 Avanade Inc. All Rights Reserved. 7

8 Diagnostics: Many Data Points Assume sampling 10 performance counters every 30 seconds on an Azure application with 2 Web Roles and 2 Worker Roles. Each Web Role has 2 instances and each Worker Role has 2 instances: 8 total instances to track 80 records every 30 seconds, or 160 records per minute 230,000 Data Points Per Day Search Engine: Twitter Feed Search Indexer ~100 Instances, Tracking 9 performance counters, 30 second sampling rate 900 records per 30 seconds = 1,800 records per minute 1,440 minutes per day * 1,800 records per minute = 2,592,000 Data Points Per Day Copyright 2009 Avanade Inc. All Rights Reserved. 8

11 ebay ebay is the world s largest marketplace and is a world leader in shopping and payments in the web Developer Eclipse IDE Request /Status Compute Nodes running Database (MySQL) Logs Provisioning Node Azure Storage Request/ Status Logs Compute Nodes Running ebay Apps (Tomcat) Original Solution Data (MySQL connection) Users Azure Solution Copyright 2009 Avanade Inc. All Rights Reserved. 11

14 Emergency Web Solution Normal Operation A Publish Area (content staging) exists where content can be prepared before it is visible to the public Content Editor XML Publish (content staging) Runtime Publishing area can accept content both via manual updates and via XML feeds Normal Normal Emergency Mode Customer can themselves trigger Emergency Mode Emergency Web is a simplified high performing web site and is separated from normal web to isolate capacity issues under extreme load Emergency Web can be deployed to data center closest to the event region Publish (content editing) Normal Runtime Normal Emergency Web! Copyright 2009 Avanade Inc. All Rights Reserved. 14

16 Original Solution CDNs Users Digital Content Billing Transcoding Engine Origin Digital Servers Azure Solution Users Digital Content Transcoder Manager Transcoders CDNs Billing Origin Digital Servers Copyright 2009 Avanade Inc. All Rights Reserved. 16

18 Grid Architecture Framework The Grid Concept leverages the availability of computing resources for multiple/parallel task execution Original Solution Azure Solution Copyright 2009 Avanade Inc. All Rights Reserved. 18

20 Original Solution Azure Solution FNOL Presentation AICS Presentation ASPX Code Behind Custom Web Controls UI Context BG Proc Windows Windows Services Windows Services Services Reference Tables Channel/Web State Management Navigation Text/String I18N Enterprise FNOL Business Custom Data Type PC Interface Process Controller FNOL Data PC Creator AICS Business Validation Configuration Currency AICS Data Security Logging Performance AICS DB Custom Data Type SC Interface Server Component SC Creator Data Access Transaction Management Asynchronous File Management Identity Management MQ Series Error Management Remoting Claims : Existing Logical View On-Premises Servers Copyright 2009 Avanade Inc. All Rights Reserved. 20

24 End User/ Agency User Agency systems End User systems Other Web sites Certificate Authority Enterprise certificate Portal (SharePoint) Authentication (3rd Party OpenSSO, JEE) 3 rd party services MyID Authorization My Profile Archive (.NET) BuyPass BankID Service engine (.NET, WCF, Forms Server) Statistics and analysis (Para Data) (SQL, SSIS) Register (.NET, WCF) Payment (.NET, WCF) Payment provider Intermediary (BizTalk) Public registers Service owner systems Copyright 2009 Avanade Inc. All Rights Reserved. 24

25 End User/ Agency User Agency systems End User systems Other Web sites Certificate Authority Enterprise certificate Portal (SharePoint) Authentication (3rd Party OpenSSO, JEE) 3 rd party services MyID Authorization My Profile Archive (.NET) BuyPass BankID Service engine (.NET, WCF, Forms Server) Statistics and analysis (Para Data) (SQL, SSIS) Register (.NET, WCF) Payment (.NET, WCF) Payment provider Intermediary (BizTalk) Public registers Service owner systems Copyright 2009 Avanade Inc. All Rights Reserved. 25