Lessons learned from a large scale OSGi web app. Jago de Vreede Paul Bakker

Transcription

1 Lessons learned from a large scale OSGi web app Jago de Vreede Paul Bakker

2 Paul

3 Jago de Vreede

4 Agenda! High level architecture Modular architecture Modularity with OSGi Cloud deployments with Apache ACE Frontend frameworks

5 Ask whenever you want!

6 The case PulseOn! Educational system focussed on personalized learning! Used in high schools in the Netherlands! Expand to other countries in the near future

7 Tools bndtools Eclipse OSGi plugin Eclipse Source control Cloud provisioning WebStorm webstorm/ Stash, Jira, Bamboo

8 High level architecture Requirements:! Agile and modular Modern web app UI mostly offloaded to clients or devices Integration via REST API Horizontally scalable A m d a t u HTML 5 + JavaScript RESTful services OSGi services Apache Felix Mongo S3

9 Components Auth Blob stores MongoDB Multi-tenancy OpenSocial Search Remote Services REST Template Web...

10 Deployment Load Balancer Load Balancer PulseOn adn PulsLo eo Mongo Mongo Mongo PulseOn Load PulseOn PulseOn School B PulseOn School A Load Balancer Mongo Mongo Mongo DAMS LoMad DA S DAMS Content backend Mongo Mongo Mongo

11 Profiles Rest Progress Rest services... Rest all the way down Profiles API Progress API Curriculum API... API Profiles Service Progress Service Curriculum Service... Service MongoDB MongoDB MongoDB

12 A service should only do one single thing

13 Services are the (reusable) building blocks of our application

14 Benefits of a services based architecture! Small services are easy to maintain Small services are composable Services are easily testable

15 Packaging services Services are packaged in small bundles Related bundles may be generated from a single Bndtools project

16 Data Storage

17 Semantic data store (triple store) MySQL (with JPA) MongoDB Beginning Now

18 Relational databases in a modular system A part of data should be owned by 1 service How to set boundaries in a relational world!?

19 Relational databases in the modern web! ORM is REALLY difficult to get right Relational databases don t scale well

20 MongoDB: our database of choice Object Mapping trivial Easy to scale Powerful aggregation/map-reduce framework!

21 Code example: MongoDB with Amdatu Amdatu Mongo Service Setup Object Mapper Execute query

22 Release & Deployment

23 Binaries Release to release repo Release to release OBR

24 JavaScript minification closure compiler deterministic? => fixed March 3, 2014 Baseline OBR Release OBR CI Build Server

25 Deployment Software distribution framework Manages the installation and upgrade of bundles, configuration, etc. to heterogenous targets

26 Deployment Load Balancer Load Balancer PulseOn adn PulsLo eo Mongo Mongo Mongo PulseOn Load PulseOn PulseOn School B PulseOn School A Load Balancer Mongo Mongo Mongo DAMS LoMad DA S DAMS Content backend Mongo Mongo Mongo

27 Deployment PulseOn Load Balancer Load PulseOn PulseOn School Load Balancer DAMS Load DAMS DAMS Content backend

28 Deployment Load Balancer Apache ACE Target TaLrogad et Target School Load Balancer Target TaLrogad et Target Content backend Release OBR Baseline OBR CI Build Server

29 Continuous Deployment Load Balancer TaLrogad et School Apache ACE Snapshot OBR CI Build Server Load Balancer TaLrogad et Content backend Like to know more? Continuous Automated Deployment with Apache ACE youtube.com/watch?v=4s_zvgg_mlw

30

31 Unit testing OSGi code is trivial But what if we want more?

32 Integration testing turns out to be trivial as well! Automated dependency injection of service Setup Config Admin Junit style asserts

33 Frontend frameworks

34 jquery Pros Easy to get started Can do a lot with not much code Lot of helpful plugins available

35 jquery Cons Hard to maintain Hard to test

36 Backbone.js Pros Well structured Designed towards consuming REST data

37 Backbone.js Cons A LOT OF CODE!! Hard to maintain Testable

38 AngularJS

39 AngularJS Pros Well structured Designed towards consuming REST data Testable No guessing in html

40 TypeScript Pros compile time checks Well structured Code completion

41 TypeScript Cons Need to have a definition Well to work structured Slow-ish

42 Wrap up A modular architecture gives us: Maintainability!! Extensibility Freedom to change

43 But what if I want Spring EJB Hibernate? Just don t You really don t need to.

44 Cloud provisioning Cloud OSGi services Amdatu Paul Eclipse OSGi plugin That s us Jago de Vreede jago.devreede@luminis.eu

45 Learn more? Friday or !! Tutorial Developing modular cloud applications with OSGi