Modularity in the cloud. A case study

Transcription

1 Modularity in the cloud A case study

2 Paul Bakker Architect at Luminis

3 The case Educational system focussed on personalized learning Used in high schools in The Netherlands Expand to other countries in the near future

4

5 Cross device HTML 5 + JS A RESTful web services m d a OSGi services t u Apache Felix Mongo S3

6 Amdatu: OSGi Cloud components JAX-RS Apache Licensed open source project MONGO DB BlobStores Multi-tenancy Search OpenSocial...

7 Some numbers 190 bundles in a deployment 120 PulseOn bundles

8 Deployment Load Balancer Load Balancer PulseOn nodeload PulseOn node PulseOn node School A PulseOn node PulseOn node PulseOn node School B Mongo Mongo Mongo Mongo Mongo Mongo

9 Availability zones Load Balancer PulseOn node PulseOn node PulseOn node PulseOn node PulseOn node PulseOn node Mongo Mongo Mongo Mongo Mongo Mongo Availability Zone 1 Availability Zone 2

10 Horizontal scalability Horizontal scaling requires stateless nodes HTML5 clients need less server side state Any state should go to some kind of store

11 Auto scaling Considerable higher loads during school hours Enough capacity Without paying for idle servers at night...

12 Cluster per school Load Balancer small node Always use a load balancer because we don t want downtime during scaling

13 Early morning... Load Balancer small node

14 Early morning... Load Balancer small node large node large node

15 End of the day... Load Balancer small node large node large node

16 End of the day... Load Balancer small node

17 But how do we install our software on a node?

18 Provisioning servers

19 User Interface ace screenshot REST API Shell scripting

20 Provisioning servers AWS Auto Scaling 1. Start Load Balancer Node 2. register 3. register 4. provision Apache ACE deployment package

21 ./as- create- launch- config demo - - image- id ami- 0ee8e07a - - instance- type m1.small - - region eu- west group sg- ce1420ba - - user- data- file userdata.txt./as- create- auto- scaling- group demo - - launch- configuration demo - - min- size max- size availability- zones eu- west- 1a - - load- balancers demo - - tag "k=name,v=demo,p=true"

22 Build releases CI server 1. GIT tag -runbundles: org.apache.felix.http.jetty;version=2.2.0,\ org.apache.felix.gogo.command;version=0.10.0,\ org.apache.felix.gogo.runtime;version=0.10.0,\ org.apache.felix.gogo.shell;version=0.10.0,\ osgi.cmpn;version='(4.2.0,4.2.1]',\ org.amdatu.security.tokenprovider.api;version=latest,\ org.amdatu.security.tokenprovider.impl;version=latest,\ org.amdatu.web.rest.doc,\ com.lopexs.arl.opensocial.config;version=latest,\ jackson-core-asl,\ 4. Distribution 2. Baseline 3. Publish Apache ACE 5. Provision Release OBR Targets

23 How do we know which bundles to update?

24 Semantic versioning is usually about package versions Export-Package: org.apache.felix.dm;version="3.1.0"

25 Semantic versioning demystified x major.minor.micro(.qualifier) Major: Backward incompatible change Minor: Backward compatible change Micro: Implementation change Qualifier: Label, e.g. build number

26 Semantic versioning on bundles Bundle-Version: Important for deployment!

27 Baselining Bytecode analysis Compare build with latest release Check if version numbers should be bumped

28 Continuous deployment CI server 1. GIT tag -runbundles: org.apache.felix.http.jetty;version=2.2.0,\ org.apache.felix.gogo.command;version=0.10.0,\ org.apache.felix.gogo.runtime;version=0.10.0,\ org.apache.felix.gogo.shell;version=0.10.0,\ osgi.cmpn;version='(4.2.0,4.2.1]',\ org.amdatu.security.tokenprovider.api;version=latest,\ org.amdatu.security.tokenprovider.impl;version=latest,\ org.amdatu.web.rest.doc,\ com.lopexs.arl.opensocial.config;version=latest,\ jackson-core-asl,\ 4. Distribution 2. Baseline 3. Publish Apache ACE 5. Provision Release OBR Snapshot OBR CD server

29 How does this fit other applications? Works in the The architecture fits most modern web cloud (but not a requirement) applications Tooling and frameworks are now mature enough

30 amdatu.org

31 Recommended reading ;)

32 There is more... Tomorrow Two hour introduction to OSGi

33 There is more... Cloud provisioning Cloud OSGi services Eclipse OSGi plugin That s us

34 Merci Mahalo Dank U Danke Grazie Obrigado Takk Gracias Thank you