IT Home 2015 DevOps 研 討 會

Transcription

1 IT Home 2015 DevOps 研 討 會 百 人 工 研 院 團 隊 如 何 落 實 CI 雙 子 星 雲 端 運 算 公 司 符 儒 嘉 執 行 長 GOCC Internal Use Only

2 Agenda DevOps What does it mean? From Agile to DevOps ITRI Cloud OS development process Tools Process People Summary GOCC Internal Use Only 2

3 New Invention Adoption Courtesy of Ray Kurzweil and Kurzweil Technologies, Inc GOCC Internal Use Only 3

4 Technology changes just as fast Digitization, Internet, and Big Data leads to the wide adoption of Cloud Services and the era of globally-connected society GOCC Internal Use Only 4

5 DevOps What does it mean? Business evolution is driving the rate of change of Web applications Waterfall model breaks down, Ken Schwaber brings in iterative, incremental development, aka Agile methodology Rapid and Frequent delivery by Development drives pressure into Operations team The same agile methodology for Development must now also apply to Operations DevOps is the iterative collaboration model between Development & Operations GOCC Internal Use Only 5

6 Agile Development It all starts here Agile Practice Frequent delivery of releasable software Empowerment of individuals and teams Continuous communication, collaboration and improvement Responsiveness to change Velocity Prioritize to maximize value Attention to quality Agile Values (manifesto) Individuals & Interactions over process & tools Working software over comprehensive documenation Customer collaboration over contract negotiation Responding to change over following a plan GOCC Internal Use Only 6

7 From Agile to DevOps Products Delivered Scrum Iterative Deliverables SIT WebApp Scaling + Cloud Infrastructure CI Regression UAT Need to know WHAT & HOW to test Feedback GOCC Internal Use Only 7

8 ITRI Cloud OS a complex system 11. Messaging Server 12. User Management 1. Cloud Application Managemen t 1.5 DCSS API Server 2. Physical Resource Managemen t 10. Repository Manager 9. Security ITRI Cloud OS 3. Virtual Cluster Provisioning 4. Virtual Machine Managemen t 8. System & Network Management 7. Distributed Secondary Storage 6. Distributed Main Storage 5. Server Load Balancing GOCC Internal Use Only 8

9 ITRI Cloud OS SDLC Sprint Reqmts Chkout from RIB Continuous build Coding Unit & Function Test Code Review Feature Integrate Build CI SIT RC Build Internal Beta Commit to Feature Branch Commit to RIB Release GOCC Internal Use Only 9

10 Scrum Development todo WIP done GOCC Internal Use Only 10

11 Review Board (by Google) Keep track of everything that needs fixing GOCC Internal Use Only 11

12 Branching Methodology Feature Branch Feature/Requirement Coding Code Review Commit Design Spec Spec Review Coverity Analysis Regression Test Demo RIB Daily Build Daily Deploy Regression Test Release Integration Branch Auto Build Auto Deploy Acceptance Test Acceptance Report (KGB) Regression Test Regression Report Coverity/Understand Analysis Release Candidate Release Candidate Branch Internal Beta Duration/Stress Test Release Product Platform GOCC Internal Use Only 12

13 Continuous Integration Feature Implementation No Passed? No No Unit Test Passed? Yes Checkin to SVN (+ dependent components) Passed? Yes Tag Request Midnight Releng build NNN SIT test vs. BOM list in build NNN Passed? Yes Yes Known Good Build (KGB) No Daily at 5pm Jenkins driven Feature Integration test 9am next morning SIT Brief test NO GOOD build SIT Full Test & Release GOCC Internal Use Only 13

14 System Integration Test Auto-report bug reports test case statistic Auto-test JIRA verify close source code Spira result build control scripts Jenkins library test result test request test cases Robot test cases tag SVN deploy request developers tester build machine build build archive STAF scripts deploy Auto-deploy test cell GOCC Internal Use Only 14

15 Test case Management GOCC Internal Use Only 15

16 Jira Issue workflow Release Branch 7.Hot Fix 8.Verify/Close 1.Open Release Integration Branch 8.Verify/Close Jira 7.Fix 2.Bug Mgr 3.Team Lead Assign 1.Open Resolve or Return Investigate 4.RD 6.Demo 5.SIT GOCC Internal Use Only 16

17 Internal Beta - EYODF 2 full racks in the container 90+ servers 3 storage servers >200TB Workload Developer build/compile/test Win 7 Office images Test sandboxes Simulates workloads GOCC Internal Use Only 17

18 Quantifiable result (1) GOCC Internal Use Only 18

19 Quantifiable Results (2) GOCC Internal Use Only 19

20 軟 體 持 續 整 合 交 付 技 術 (DevOps) Toolchain 開 發 敏 捷 開 發 整 合 測 試 持 續 整 合 測 試 版 本 發 行 持 續 整 合 交 付 產 品 上 線 GOCC Internal Use Only 20

21 Infrastructure as Code (1) Leverage Cloud to test Cloud Testing sandbox Virtual containers (Google Kerbernets) Open source tools are abundant GOCC Internal Use Only 21

22 Infrastructure as Code (2) GOCC Internal Use Only 22

23 Software Engineering Process Tools - Robot - Spira - Selenium - Calabash 2015/9/3 GOCC Internal Use Only 23

24 Process Tools are abundant to enforce the following processes: Scrum Development Code Reviews Branching methodology Continuous Integration testing Test automation and test case management Bugs/Problems management SIT Release methodology UAT But GOCC Internal Use Only 24

25 The People Factor GOCC Internal Use Only 25

26 Summary DevOps is an evolution from Agile; It comes from pressure on operations There are tons of tools in place Repeatable process improves accountability Faster feedback prevents further failures But it all depends on people taking ownership and work collaboratively to suceed Enable, Participate, Improve GOCC Internal Use Only 26

27 30 年 前, 台 積 電 董 事 長 張 忠 謀 擔 任 工 研 院 院 長, 帶 領 一 批 團 隊 創 辦 了 台 積 電, 開 啟 了 這 將 近 30 年 的 台 灣 電 子 與 科 技 產 業 的 榮 景, 為 台 灣 創 造 了 無 比 的 產 業 競 爭 力 今 天, 雲 端 軟 體 產 業 在 台 灣 仍 是 一 片 待 填 補 的 空 白, 雙 子 星 也 希 望 能 如 同 當 年 台 積 電 一 般, 以 工 研 院 孕 育 的 技 術 成 果 為 基 礎, 為 台 灣 雲 端 軟 體 產 業, 貢 獻 一 份 心 力 感 謝 聆 聽 敬 請 指 導 GOCC Internal Use Only 27