@tobiastrelle. codecentric AG 1

Size: px

Start display at page:

Download "Tobias.Trelle@codecentric.de @tobiastrelle. codecentric AG 1"

Benjamin Gibson
8 years ago
Views:

1 NoSQL Unit & Travis CI Test Automation for NoSQL codecentric AG 1

2 Tobias Trelle Senior IT codecentric AG Organizer of MongoDB User Group Düsseldorf Author of MongoDB Ein praktischer Einstieg (dpunkt-verlag) codecentric AG 2

3 Agenda Unit Testing NoSQL Unit Travis CI codecentric AG 3

4 Unit Testing Your Persistence Layer Production UI Layer Business Layer Persistence Layer DAO / Repository Database codecentric AG 4

5 Unit Testing Your Persistence Layer Production Unit Test UI Layer UI Layer Business Layer Business Layer Persistence Layer DAO / Repository Persistence Layer DAO / Repository Database Embedded Database In Process Unit Test codecentric AG 5

Layer DAO / Repository Persistence Layer DAO / Repository

6 Unit Testing Your Persistence Layer Unit tests should be fast run in isolation load test data compare data codecentric AG 6

7 NoSQL Unit Github - codecentric AG 7

8 NoSQL Unit > Overview Benefits Database Lifecycle Management Connection Management Load Test Data Compare Data codecentric AG 8

9 NoSQL Unit > Overview How does it work? JUnit Extension JUnit Rules Annotations codecentric AG 9

10 NoSQL Unit > Database Management Options JVM Database Managed NoSQL Unit Remote Database Embedded Database Local Machine Remote Machine codecentric AG 10

11 NoSQL Unit > Supported Databases Database Type Impl Language Cassandra Column Java CouchDB Document Erlang Embedded Managed / Remote --- Elasticsearch Document Java HBase Column Java Infinispan In Memory Java MongoDB Document C++ Neo4j Graph Java Redis Key/Value C/C++ fongo Mock NoSQL Unit Mock codecentric AG 11

Document Java HBase Column Java Infinispan In Memory Java MongoDB Document C++

12 NoSQL Unit > Lifecycle NoSQL Unit Database Test Case Launch (optional) Connect to Loop over tests Load Test Data (optional) Run Test Compare Data Sets (optional) Shutdown (optional) Interact with codecentric AG 12

Test Data (optional) Run Test Compare Data Sets

13 NoSQL Unit > Redis Example public class EmbeddedRedisTest { Create embedded instance once for all public static EmbeddedRedis embeddedredis = public RedisRule redisrule = newredisrule().defaultembeddedredis(); /** Unit under test. */ private loadstrategy = LoadStrategyEnum.DELETE_ALL location="keyvalue.json" ) Compare given and public void should_insert_string() { // given expected data after test KeyValueRepository repo = new KeyValueRepository( getjedisinstance() ); // when repo.setvalue("hello", "redis"); Get connection once per test Prepare data // then: should match data } codecentric AG 13 }

$json" ) Compare given and public void should_insert_string() { // given expected data after test KeyValueRepository repo = new KeyValueRepository( getjedisinstance() ); // when repo.$

14 NoSQL Unit > Redis Example > keyvalue.json { } "data": [ {"simple": [ { "key":"hello", ", "value":"redis"} ] } ] codecentric AG 14

15 NoSQL Unit > MongoDB Example public class RemoteMongoDBTest // use already running "remote" instance public MongoDbRule mongorule = new MongoDbRule( mongodb().databasename("test").host( ).host("localhost").port(27017).build() ); /** Unit under test. */ private OrderRepository repository; Load test data from = "orders.json", loadstrategy = LoadStrategyEnum.CLEAN_INSERT) public void should_find_all_orders() { // given repository = createorderrepository(); // when List<DBObject> orders = repository.findall(); // then assertthat(orders, notnullvalue()); assertthat(orders.size(), is(2)); codecentric AG 15 }

$CLEAN_INSERT) public void should_find_all_orders() { // given repository = createorderrepository(); // when List<DBObject> orders = repository.$

16 NoSQL Unit > MongoDB Example > orders.json { } "orders": [ { "type": 4711, "desc":": "1st order" }, { "type": 42, "desc":": "2nd order" } ] codecentric AG 16

17 NoSQL Unit > MongoDB > Advanced Features NoSQL Unit MongoDB supports Replica Sets Sharded Environments Sharded Env. + Replica Sets in managed mode. codecentric AG 17

18 Travis CI codecentric AG 18

19 Travis CI > Overview Free Continuous Integration Platform: Lanuguages: C/C++ Closure Erlang Go Groovy Java JavaScript / Node.js Objective-C Ruby Scala codecentric AG 19 Services: MySQL PostgreSQL MongoDB CouchDB Redis Riak RabbitMQ Memcached Cassandra Neo4j

Node.js Objective-C Ruby Scala codecentric AG 19 Services: MySQL

20 Travis CI > Lifecycle Travis CI Tests Database GitHub clone / checkout start services build & run use.travis.yml: language: java services: - mongodb - redis shutdown services codecentric AG 20

21 Travis CI > Demo codecentric AG 21

22 Travis CI > Demo codecentric AG 22

23 Travis CI > Demo codecentric AG 23

24 Online Resources NoSQL Unit Travis CI NoSQL Unit Examples AG 24

25 MongoDB User Group Düsseldorf Meetup #10: MongoDB at LUMsearch.com (by Christian Douven) , 19:00 codecentric AG 25

26 QUESTIONS? Tobias Trelle codecentric AG Merscheider Str Solingen tel +49 (0) fax +49 (0) mail Tobias.Trelle@codecentric.de blog.codecentric.de/en/author/tobias-trelle codecentric AG 26

Cloud Scale Distributed Data Storage. Jürmo Mehine

Cloud Scale Distributed Data Storage Jürmo Mehine 2014 Outline Background Relational model Database scaling Keys, values and aggregates The NoSQL landscape Non-relational data models Key-value Document-oriented