Assembling a kernel test grid with autotest

Transcription

1 Lucas Meneghel Rodrigues LinuxCon Europe 2012 November 5th, 2012

2

3 The case for automated testing Linux moves fast Thousands of new commits per week

4 The case for automated testing Linux moves fast Thousands of new commits per week Thousands of potential new bugs per week

5 The case for automated testing Linux moves fast Thousands of new commits per week Thousands of potential new bugs per week It s better if they re spot on quickly

6 Test soon, test frequently Linux development and deployment Months from patchset accepted to user running code

7 Test soon, test frequently Linux development and deployment Months from patchset accepted to user running code Submaintainers are good, but not perfect

8 Test soon, test frequently Linux development and deployment Months from patchset accepted to user running code Submaintainers are good, but not perfect More testing made before code gets to maintainers is a win

9 Open source project, containing: Userspace tools

10 Open source project, containing: Userspace tools Libraries

11 Open source project, containing: Userspace tools Libraries Test modules

12 Open source project, containing: Userspace tools Libraries Test modules Designed for the kernel, useful for userspace too

13 structure

14 modules Client: Executes tests in test machines

15 modules Client: Executes tests in test machines Server: Copies client code to the test machines

16 modules Client: Executes tests in test machines Server: Copies client code to the test machines Scheduler: Schedules test jobs according to user input

17 modules Client: Executes tests in test machines Server: Copies client code to the test machines Scheduler: Schedules test jobs according to user input Frontends: Allows users to run jobs and visualize results

18 Install recipe Ingredients Two machines, running Fedora 17 (or Ubuntu 12.04)

19 Install recipe Ingredients Two machines, running Fedora 17 (or Ubuntu 12.04) Download the install script and execute it

20 Install recipe Ingredients Two machines, running Fedora 17 (or Ubuntu 12.04) Download the install script and execute it Optional: Cobbler server

21 Install

22 Machine Control How to control power/serial/provisioning Console - Conmux

23 Machine Control How to control power/serial/provisioning Console - Conmux Provisioning - Cobbler

24 Machine Control How to control power/serial/provisioning Console - Conmux Provisioning - Cobbler Both can do machine power control

25 KVM PPC lab

26 Kernel testing (no machine install) from a u t o t e s t. c l i e n t. s h a r e d import g i t d e f s t e p i n i t ( ) : j o b. n e x t s t e p ( [ s t e p t e s t ] ) repo = g i t : / / g i t h u b. com/ foo / l i n u x. g i t repo = g i t. GitRepoHelper ( u r i=repo ) repo. e x e c u t e ( ) k e r n e l = j o b. k e r n e l ( repo. d e s t i n a t i o n d i r ) k e r n e l. b u i l d ( ) k e r n e l. i n s t a l l ( ) k e r n e l. boot ( ) d e f s t e p t e s t ( ) : j o b. r u n t e s t ( kernbench )

27 Kernel testing (machine install) c o n t r o l = s t r i n g with p r e v i o u s c o n t r o l d e f run ( machine ) : h o s t = h o s t s. c r e a t e h o s t ( machine ) p r o f i l e = Fedora17 x86 64 timeout = 3600 h o s t. m a c h i n e i n s t a l l ( p r o f i l e=p r o f i l e, timeout=timeout ) at = a u t o t e s t r e m o t e. A u t o t e s t ( h o s t ) at. run ( c o n t r o l ) j o b. p a r a l l e l s i m p l e ( run, machines )

28 Limitations: Embedded Lots of autotest were designed with Intel in mind: Machine provisioning

29 Limitations: Embedded Lots of autotest were designed with Intel in mind: Machine provisioning Boot selection

30 Limitations: Embedded Lots of autotest were designed with Intel in mind: Machine provisioning Boot selection Serial Console

31 Limitations: Embedded Lots of autotest were designed with Intel in mind: Machine provisioning Boot selection Serial Console Help needed to implement embedded

32 Changes in autotest (last year) Lots of work under the hood Namespace fixes and cleanups

33 Changes in autotest (last year) Lots of work under the hood Namespace fixes and cleanups Improved release management

34 Changes in autotest (last year) Lots of work under the hood Namespace fixes and cleanups Improved release management Fedora packaging work done

35 Changes in autotest (last year) Lots of work under the hood Namespace fixes and cleanups Improved release management Fedora packaging work done Stand alone RPC client

36 What now? Advanced machine scheduling

37 What now? Advanced machine scheduling Evolve RPC applications

38 What now? Advanced machine scheduling Evolve RPC applications API for automated bisecting

39 What now? Advanced machine scheduling Evolve RPC applications API for automated bisecting Better support for embedded/socs

40 What now? Advanced machine scheduling Evolve RPC applications API for automated bisecting Better support for embedded/socs You all are welcome to help

41 Questions?

42 Resources and contact irc://irc.oftc.net/#autotest mailing list