Pro Puppet. Jeffrey McCune. James TurnbuII. Apress* m in

Size: px

Start display at page:

Download "Pro Puppet. Jeffrey McCune. James TurnbuII. Apress* m in"

Eric McDonald
8 years ago
Views:

1 Pro Puppet m in James TurnbuII Jeffrey McCune Apress*

2 About the Authors About the Technical Reviewer Acknowledgments Introduction Chapter 1: Getting Started with Puppet What Is Puppet? Deployment Configuration Language and Resource Abstraction Layer. Transactional Layer Selecting the Right Version of Puppet Can I mix releases of Puppet? Installing Puppet Installing on Red Hat Enterprise Linux and Fedora Installing on Debian and Ubuntu Installing on OpenSolaris Installing from Source Installing on Microsoft Windows Installing on other Platforms Configuring Puppet The site.pp file Firewall Configuration Starting the Puppet Master Connecting Our First Agent

Transactional Layer Selecting the Right Version of Puppet Can I mix releases of Puppet?

3 a CONTENTS Completing the Connection 17 Creating Our First Configuration 18 Extending the site.pp file 19 Agent Configuration 20 Creating our first module 21 Module Structure 21 The initpp file 22 Applying Our First Configuration 24 Summary 26 Resources 27 i Chapter 2: Building Hosts with Puppet 29 Getting Started 30 Installing Puppet 30 Configuring Nodes 31 Making (More) Magic With Modules 36 Version Controlling Your Modules 36 Creating a module to Manage SSH 38 Managing Our Classes 40 Creating a Module to Manage Postfix 48 The postfix-install class 48 The postfix.-.config class 49 The postfix::service class 51 Managing MySQL with the mysql Module 53 The mysql::install class 54 The mysql::config class 54 The mysql::service class 55 vi

Hosts with Puppet 29 Getting Started 30 Installing Puppet 30 Configuring Nodes 31 Making (More) Magic With Modules 36 Version Controlling Your Modules 36 Creating a module to Manage SSH

4 CONTENTS Managing Apache and Websites 56 The apache-install class 56 The apache::service class 57 The Apache definition 57 Managing Puppet with the Puppet Module 60 Summary 63 Resources 64 Chapter 3: Working with Environments..65 Configuring Puppet Environments 66 Populating the New Environments 67 Making Changes to the Development Environment 68 Testing the New Environments with the Puppet Agent 70 Environment Branching and Merging 72 Setting Up a Central Repository 73 Developing a Change Using a Branch 75 Merging Changes into a Testing Environment 83 Production Environment Releases 86 Summary 88 Resources 88 Chapter 4: Puppet Scalability 89 Identifying the Challenges 89 Running the Puppet Master with Apache and Passenger 90 Installing Apache and Passenger on Enterprise Linux 90 Installing Apache and Passenger on Debian-Based Systems 91 Installing Passenger Using Ruby Gems 92 Configuring Apache and Passenger 93 Testing the Puppet Master in Apache 96 vii

.65 Configuring Puppet Environments 66 Populating the New Environments 67 Making Changes to the Development Environment 68 Testing the New Environments with the Puppet Agent 70 Environment Branching

5 * CONTENTS Load-Balancing Multiple Puppet Masters 97 HTTP Load Balancing 97 Puppet CA Load Balancing Configuration 107 Measuring Performance 116 Splay Time 117 Summary 118 Resources 118 Chapter 5: Externalizing Puppet Configuration 119 External Node Classification 120 Configuring Nodes Using An External Node Classifier 121 An External Node Classifier in a Shell Script 121 A Ruby External Node Classifier 122 A Perl External Node Classifier 124 Back-Ending a Node Classification 125 Storing Node Configuration in LDAP 127 Installing Ruby LDAP Libraries 127 Setting Up the LDAP Server 127 Adding the Puppet Schema 128 Configuring LDAP in Puppet 128 Summary 131 Resources 131 m Chapter 6: Exporting and Storing Configuration 133 Virtual Resources 133 Declaring and Realizing a Virtual Resource 134 Applying the Realize Function 135 Making Virtual Resources Real 135 Relationship-Chaining Syntax 136 viii

Classifier 122 A Perl External Node Classifier 124 Back-Ending a Node Classification 125 Storing Node Configuration in LDAP 127 Installing Ruby LDAP Libraries 127 Setting Up the LDAP Server 127

6 i CONTENTS Getting Started with Exported and Stored Configurations 137 The Stored Configuration Database Server 137 Configuring Puppet Master for Stored Configuration 140 Adding a MySQL Table Index 142 Using Exported Resources 143 Automated SSH Public Host Key Management 143 Exporting Load Balancer Worker Resources 145 Automating Nagios Service Checks 147 Scaling Stored Configurations 151 Thin Stored Configurations 151 Queue Support for Stored Configurations 152 Installing ActiveMQ on Enterprise Linux-Based Systems 152 Installing ActiveMQ on Debian-Based Systems 154 Puppet Master Queue Configuration 156 Expiring Stale Resources 157 Summary 158 Resources 158 i Chapter 7: Puppet Consoles: Puppet Dashboard and The Foreman 159 Puppet Dashboard 159 Installing Puppet Dashboard 160 Configuring the Dashboard 163 Running Puppet Dashboard 165 Integrating Puppet Dashboard 169 External Node Classification 173 Logging, Database Backup and Performance 175 The Foreman 176 Installing Foreman 177 Configuring Foreman 178 ix

Stored Configurations 151 Queue Support for Stored Configurations 152 Installing ActiveMQ on Enterprise Linux-Based Systems 152 Installing ActiveMQ on Debian-Based Systems 154 Puppet Master Queue

7 * CONTENTS Starting Foreman 180 Integrating Foreman's Capabilities 181 Displaying Reports in Foreman 183 Displaying Nodes Information in Foreman 184 Using Foreman to trigger Puppet 185 Summary 186 Resources 186 i Chapter 8: Tools and Integration 189 Puppet Forge and Module Tool 189 Installing the Puppet Module Tool 190 Searching and Installing a Module from the Forge 191 Using a Module 192 Creating a Module with the Puppet-Module Tool 195 Puppet Ruby DSL 205 The Problem: Resources from Data 205 Declaring Resources from Data 206 Cucumber Puppet 216 Installing Cucumber Puppet 217 Writing a Story 218 Testing the Basic Catalog Policy 222 Validating Specific Resources 224 Summary 229 Resources 229 Chapter 9: Reporting with Puppet 231 Getting Started 231 Configuring Reporting 233 Report Processors 234 log 234 x

Creating a Module with the Puppet-Module Tool 195 Puppet Ruby DSL 205 The Problem: Resources from Data 205 Declaring Resources from Data 206 Cucumber Puppet 216 Installing Cucumber Puppet 217 Writing

8 * CONTENTS tagmail 235 rrdgraph 236 http 237 Custom Reporting 237 Summary 240 Resources 240 Chapter 10: Extending Facter and Puppet 241 Writing and Distributing Custom Facts 241 Configuring Puppet for Custom Facts 241 Writing Custom Facts 243 Testing the Facts 245 Developing Custom Types, Providers and Functions 246 Configuring Puppet for Types, Providers and Functions 246 Writing a Puppet Type and Provider 247 Writing a Parsed File Type and Provider 253 A More Complex Type and Provider 255 Testing Types and Providers 259 Writing Custom Functions 260 Summary 262 Resources 263 ii Chapter 11: Marionette Collective 265 Installing and Configuring RabbitMQ 266 Installing RabbitMQ on Debian 267 Installing RabbitMQ on RHEL / CentOS 269 RabbitMQ Configuration 270 Installing MCollective on Debian and Ubuntu 271 Installing MCollective on Enterprise Linux 273 MCollective Server Configuration 274 xi

Type and Provider 247 Writing a Parsed File Type and Provider 253 A More Complex Type and Provider 255 Testing Types and Providers 259 Writing Custom Functions 260 Summary 262 Resources 263 ii

9 CONTENTS MCollective Plugins 276 Puppet Agent MCollective Plugins 277 The Facter Plugin for MCollective 282 Additional Plugins 284 Addressing Hosts with Metadata 284 Summary 285 Resources 286 Appendix A: Working with Puppet 289 Getting Support and Training 289 Resources 289 Web 290 Mailing Lists 291 Puppet Module Forge 291 Puppet Enterprise 291 Support (commercial) 291 Training 291 IRC 291 Index 293 xii

Appendix A: Working with Puppet 289 Getting Support and Training 289 Resources 289 Web 290 Mailing

Jenkins: The Definitive Guide

Jenkins: The Definitive Guide John Ferguson Smart O'REILLY8 Beijing Cambridge Farnham Koln Sebastopol Tokyo Table of Contents Foreword xiii Preface xv 1. Introducing Jenkins 1 Introduction 1 Continuous