Grassroots Free Software In-Depth Case Study: Debian

Transcription

1 Grassroots Free Software In-Depth Case Study: Debian Stefano Zacchiroli Debian Project Leader Université Paris Diderot IRILL 21 June 2012 Insubria International Open Source Summer School Como, Italy Stefano Zacchiroli (Debian) Debian Como, Italy 1 / 112

2 Outline 1 FOSS concepts 2 Debian overview 3 Philosophy 4 Organization 5 Processes 6 Derivatives 7 Appendix: packaging tutorial 8 Appendix: contribute Stefano Zacchiroli (Debian) Debian Como, Italy 2 / 112

3 About the speaker Research associate professor (maître de conférences) at Paris Diderot research fellow at IRILL (Initiative de Recherche et Innovation sur le Logiciel Libre) Research interests component based software engineering (CBSE) formal methods for component upgrades and QA case in point: FOSS distribution packages Debian Debian Developer since March 2001 packages: OCaml, Vim, Python, math-related sw QA & infrastructure (PTS) Debian Project Leader since April 2010, 3rd term Stefano Zacchiroli (Debian) Debian Como, Italy 3 / 112

5 Free Software 1 an idea: software users should be in control of their software AKA: software users should enjoy a set of fundamental freedoms while using it 2 a social and political movement to promote software freedoms world-wide rooted in the hacker culture of the 70s and of the early UNIX-es started in 1983 by Richard Stallman, launching the GNU Project promoted since 1985 by the Free Software Foundation Stefano Zacchiroli (Debian) Debian Como, Italy 5 / 112

6 Free Software why it matters Lester picked up a screwdriver. You see this? It s a tool. You can pick it up and you can unscrew stuff or screw stuff in. You can use the handle for a hammer. You can use the blade to open paint cans. You can throw it away, loan it out, or paint it purple and frame it. He thumped the printer. This [ Disney in a Box ] thing is a tool, too, but it s not your tool. It belongs to someone else Disney. It isn t interested in listening to you or obeying you. It doesn t want to give you more control over your life. [... ] If you don t control your life, you re miserable. Think of the people who don t get to run their own lives: prisoners, reform-school kids, mental patients. There s something inherently awful about living like that. Autonomy makes us happy. Cory Doctorow, Makers craphound.com/ makers/ Stefano Zacchiroli (Debian) Debian Como, Italy 6 / 112

7 Free Software, defined Definition (Free Software) A program is free software if the program s users have the four essential freedoms: 0 The freedom to run the program, for any purpose (freedom 0). 1 The freedom to study how the program works, and change it so it does your computing as you wish (freedom 1). 2 The freedom to redistribute copies so you can help your neighbor (freedom 2). 3 The freedom to distribute copies of your modified versions to others (freedom 3). By doing this you can give the whole community a chance to benefit from your changes. Access to the source is a precondition for freedoms 1 and 3. Source: Stefano Zacchiroli (Debian) Debian Como, Italy 7 / 112

8 What About Open Source? A different point of view on similar objectives Free Software best practices as a development methodology that leads to better software major influence from The Cathedral and the Bazaar, by Eric S. Raymond that later influenced Netscape open source -ing synthesized by the Open Source Initiative (OSI) in the Open Source Definition (1981) derived from the Debian Free Software Guidelines (more on this later... ) Origin of a heated debate since then Stefano Zacchiroli (Debian) Debian Como, Italy 8 / 112

9 Distributing Free Software the early days Actors: 1 upstream software developer 2 final users Notable flows: software, fixes, bug report, patches Highlights: source distribution compilation is done on user machines by every user Stefano Zacchiroli (Debian) Debian Como, Italy 9 / 112

10 Distributing Free Software the early days (cont.) Practically, users need to: 1 download bonus point: verify checksums and GPG-sig 2 untar 3./configure 4 make 5 make install (or language-specific variants) Example Let s have a look at: Managing-Releases.html Stefano Zacchiroli (Debian) Debian Como, Italy 10 / 112

11 Distributing Free Software the early days (cont.) Pros: tight relationships between upstream and users encourage becoming involved with development Cons: confuses user and developer roles developer knowledge needed to run the software scalability update frequency trust Stefano Zacchiroli (Debian) Debian Como, Italy 11 / 112

12 Example installation issues in the early days foo is cool, let s install it! 1 download foo-1.0.tar.gz 2./configure checksum mismatch, missing public key, etc. error: missing bar, baz,... 3 foreach (bar, baz,... ) go to 1 until (recursive) success 4 make error: symbol not found 5 make install error: cp: cannot create regular file /some/weird/path now try scale that up to sources releasing new versions/month Stefano Zacchiroli (Debian) Debian Como, Italy 12 / 112

13 The notion of distribution distributions are meant to ease software management key notion: the abstraction of package offer coherent collections of software killer application: package managers Stefano Zacchiroli (Debian) Debian Como, Italy 13 / 112

14 Package manager React to user requests to alter (upgrade / install / remove) software installation: 1 dependency solving 2 software download 3 software installation as in: putting files in the right places 4 software configuration as in: doing post-installation configuration Stefano Zacchiroli (Debian) Debian Como, Italy 14 / 112

15 Package manager example Phase User request Constraint resolution Package retrieval Trace # apt-get install aterm Reading package lists... Done Building dependency tree... Done The following extra packages will be installed: libafterimage0 The following NEW packages will be installed aterm libafterimage0 0 upgraded, 2 newly installed, 0 to remove and 1786 not upgraded. Need to get 386kB of archives. After unpacking 807kB of additional disk space will be used. Do you want to continue [Y/n]? Y Get: 1 testing/main libafterimage [3 Get: 2 testing/main aterm [84.4kB] Fetched 386kB in 0s (410kB/s) Pre-configuration { Selecting previously deselected package libafterimage0. (Reading database files and directories currently installed.) Unpacking Unpacking libafterimage0 (from.../libafterimage0_ _i386.deb)... Selecting previously deselected package aterm. Unpacking aterm (from.../aterm_ _i386.deb)... Setting up libafterimage0 ( )... Configuration Setting up aterm ( )... Stefano Zacchiroli (Debian) Debian Como, Italy 15 / 112

16 Distribution concerns Distributions act as intermediaries between upstream software authors and final users. Distributions are meant to ease Free Software life cycle management. Within distributions scope: package management trusted sw delivery sw integration initial installation Outside distribution scope: upstream sw development (but beware of overlaps) sw packaging upstream release tracking bug triage and forwarding (porting) shielding users from upstream and vice-versa Stefano Zacchiroli (Debian) Debian Como, Italy 16 / 112

17 Source vs binary distribution Source distribution Binary distribution packages contain source code which get compiled (automatically) on user machines distribution takes care of compilability packages contain compiled (or binary ) code which get installed on user machines distribution takes care of compilation on all supported platforms Trade-off: distribution work vs user (machine) work Stefano Zacchiroli (Debian) Debian Como, Italy 17 / 112

18 Packages a closer look zack@usha:~% ls -al apache2-bin_ _amd64.deb -rw-r--r-- 1 zack zack mag 28 19:17 apache2-bin_ _amd64.deb Contains: 1 the actual files that come with the Apache HTTP server /usr/sbin/apache2 /usr/share/doc/apache2/readme... 2 configuration programs that get executed before/after installation start automatically Apache after installation stop automatically Apache before removal so that Apache is down during upgrade and up again immediately after 3 metadata, lots of... Stefano Zacchiroli (Debian) Debian Como, Italy 18 / 112

19 Package metadata apt cache show apache2 bin Package : apache2 bin Version : Installed Size : 3321 Maintainer : Debian Apache Maintainers <debian apache@lists. debian. org> Architecture : amd64 Replaces : apache2.2 bin (<< 2.3~), apache2.2 common Provides : apache2 api , httpd, httpd cgi Depends: libapr1 (>= ), libaprutil1 dbd sqlite3 libaprutil1 dbd mysql libaprutil1 ldap, libc6 (>= 2. 4), libldap (>= ), liblua5.1 0, libpcre3 (>= 8.10), l i b s s l (>= 1.0.1), libxml2 (>= 2.7.4), zlib1g (>= 1: ), perl Suggests : www browser, apache2 doc, apache2 suexec pristine apache2 suexec Conflicts : apache2.2 bin (<< 2.3~), apache2.2 common Description en : Apache HTTP Server ( binary f i l e s and modules ) The Apache Software Foundation s goal i s to build a secure, e f f i c i e n t and extensible HTTP server as standards compliant open source software. The result has long been the number one web server on the Internet. [... ] Homepage: http :// httpd. apache. org/ Section : httpd Priority : optional Size : MD5sum: 0f2988d78c7653ed9f967437f477059a SHA1: 31f3015b2b94dd8f9fc2f573784fe98178ccbadc Stefano Zacchiroli (Debian) Debian Como, Italy 19 / 112

20 Distributions easing software distribution: major concern in the early Free Software days distribution: a somewhat successful idea 300+ active distribution nowadays source: a distribution timeline: Stefano Zacchiroli (Debian) Debian Como, Italy 20 / 112

21 Distributions (cont.) Some axes to compare distributions: package management source vs binary distribution low-level package format (most notably: deb vs rpm) high-level package managers other technical features included/default software architectures... organization manpower: company vs volunteer decision making community availability of commercial support / expertise Review of major distributions: Stefano Zacchiroli (Debian) Debian Como, Italy 21 / 112

22 This class In-depth case study of how a major volunteer Free Software project and in particular a distribution: Debian is organized. Points of view: philosophical management technical (volunteer motivation, social structure, etc.) (decision making, project structure, etc.) Stefano Zacchiroli (Debian) Debian Como, Italy 22 / 112

24 Debian: once upon a time Fellow Linuxers, This is just to announce the imminent completion of a brand-new Linux release, which I m calling the Debian Linux Release. [... ] Ian A Murdock, 16/08/1993 comp.os.linux.development deb.li/ bigbang make GNU/Linux competitive with commercial OS easy to install built collaboratively by software experts 1 st major distro developed openly in the spirit of GNU FSF-supported for a while trivia: named after DEBra Lynn and IAN Ashley Murdock Stefano Zacchiroli (Debian) Debian Como, Italy 24 / 112

25 Since then 15 releases 1993 development snapshots r5, 0.93r6, (Buzz), 1.2 (Rex) (Bo) (Hamm) (Slink) (Potato) (Woody) (Sarge) Apr (Etch) Feb (Lenny) Feb (Squeeze) Q (?) 6.0 (Wheezy) trivia: why does Buzz have a (Debian) swirl on his chin? Stefano Zacchiroli (Debian) Debian Como, Italy 25 / 112

26 Since then 12 Debian Project Leaders (DPL) Ian Murdock Bruce Perens Ian Jackson Wichert Akkerman Ben Collins Bdale Garbee Martin Michlmayr Branden Robinson Anthony Towns Sam Hocevar Steve McIntyre yours truly Stefano Zacchiroli (Debian) Debian Como, Italy 26 / 112

27 What is Debian? 3 aspects, interlinked: 1 an operating system 2 a project 3 a community Stefano Zacchiroli (Debian) Debian Como, Italy 27 / 112

28 Debian: the operating system flagship product: Debian stable binary distribution completely Free (DFSG) DFSG contrib, non-free released every 24 months ( ) a dozen architectures amd64, armel, armhf, ia64, mips, mipsel, powerpc, s390, s390x, sparc archive-wide security support renowned for Source packages Binary packages one of the largest GNU/Linux porting platforms ports, stability, packaging system, old hardware support, documentation, smooth upgrades, i18n/l10n, the testing suite, runs anywhere, technical policy, package choice,... Stefano Zacchiroli (Debian) Debian Como, Italy 28 / 112

29 Debian 6.0 Squeeze highlights What could happen in a release cycle? dependency-based boot system (faster, more robust) completely Free Linux kernel, firmware included GNU/kFreeBSD as technology preview improved debian-installer ext4, btrfs ZFS (kfreebsd) better support for complex setups e.g. LVM + RAID + encryption get Squeeze Stefano Zacchiroli (Debian) Debian Como, Italy 29 / 112

30 Debian 6.0 Squeeze highlights (cont.) Debian Pure Blends DebianEdu, Debian Med, Debian Science, Debian Accessibility, DebiChem, Debian EzGo, Debian GIS, Debian Multimedia,... blends.alioth.debian.org/ new services snapshot.debian.org backports.debian.org squeeze-updates suite (ex-volatile) screenshots.debian.net ask.debian.net updates throughout the archive choice: GNOME, KDE Plasma, Xfce, LXDE,... get Squeeze Stefano Zacchiroli (Debian) Debian Como, Italy 29 / 112

31 Debian: the Project Common goal: Create the best, Free operating system. Debian Social Contract (1997) 100% Free Software don t hide problems give back priorities: users & Free Software Debian Constitution (1998) Structures and rules of a Free-Software-compatible democracy Strong motive to join: volunteers, world-wide Stefano Zacchiroli (Debian) Debian Como, Italy 30 / 112

32 Demography Stefano Zacchiroli (Debian) Debian Como, Italy 31 / 112

33 Demography (cont.) Developer s per country 2012 statistics: devel-countries Take a guess: your country s position? Stefano Zacchiroli (Debian) Debian Como, Italy 32 / 112

34 Demography (cont.) Figure: age histogram Bottom line: very diverse, international and inter-generation project. Stefano Zacchiroli (Debian) Debian Como, Italy 33 / 112

35 Debian: the community Open development we don t hide problem easy to have an impact (just show me the code! ) Large amounts of communication mailing lists IRC (a few) social media (growing) on identi.ca Large number of tech-savvy users users help each other, contribute patches, get involved Stefano Zacchiroli (Debian) Debian Como, Italy 34 / 112

36 Debian: one of a kind? 1993 not many distros back then 19 years later lots of other distros opensuse, Linux Mint, PCLinuxOS, Slackware, Gentoo Linux, CentOS, FreeBSD, Arch, Sabayon, Puppy, Lubuntu, MEPIS, Ultimate, NetBSD, Tiny Core, Zenwalk, CrunchBang, Dreamlinux, Vector, Kubuntu, Maemo, Red Hat, aptosid, Peppermint, PC-BSD, Chakra, Salix, ClearOS, KNOPPIX, Xubuntu, Super OS, BackTrack, gos, TinyMe, Zentyal, EasyPeasy, Frugalware, Clonezilla, Pardus, Meego, OpenBSD, Quirky, PC/OS, Zorin, Debian, SystemRescue, Element, Unity, SliTaz, Macpup, wattos, Scientific, Mythbuntu, Slax, DragonFLY, Elive, linux-gamers, 64 Studio, Ubuntu, mageia, Nexenta, Parisx, NuTyX, GhostBSD, Kongoni, moonos, LFS, Lunar, Imagineos, Untangle, Fedora, Yellow Dog, alinux, Yoper, IPFire, BlankOn, Mandriva, PureOS, FreeNAS, Moblin, Linpus, TurboLinux, blackpanther,... with many differences: technical choices support release management packaging system release schedule user base target user look & feel community... How is Debian different? Stefano Zacchiroli (Debian) Debian Como, Italy 35 / 112

37 Debian s special #1: package quality Culture of technical excellence package design: Policy i.e. how a package should look like package testing: lintian, piuparts, archive rebuilds (FTBFS),... package maintainers are software experts no 2 nd class packages, all are equal Debian release mantra we release when it s ready Stefano Zacchiroli (Debian) Debian Como, Italy 36 / 112

38 Debian s special #2: freedom Firm principles: developers and users bound by the Social Contract 1 promoting the culture of Free Software since Free the bottom up in its software firmware included! in its infrastructure no non-free web services no non-free services (for users) (for developers) Community awareness users know users trust Debian not to betray Free Software principles high bar for software freedom advocates Stefano Zacchiroli (Debian) Debian Como, Italy 37 / 112

39 Debian s special #3: independence Debian is an independent project no (single) company babysitting us living up on: 1 donations (money & hardware) 2 gift-economy... truly remarkable in today big distro world people trust Debian choices not to be profit-driven Stefano Zacchiroli (Debian) Debian Como, Italy 38 / 112

40 Debian s special #4: decision making 1 do-ocracy 2 democracy that means: An individual Developer may make any technical or nontechnical decision with regard to their own work; Debian Constitution, Each decision in the Project is made by one or more of the following: 1. The Developers, by way of General Resolution [...] reputation follows work no benevolent dictator, no oligarchy no imposed decisions by who has money, infrastructure, people,... Debian Constitution, 2 Stefano Zacchiroli (Debian) Debian Como, Italy 39 / 112

42 Social Contract History 1996 early worries about companies involvement in distro development will RedHat always remain Free? FOSS licenses are not enough to guarantee that Debian solution: a contract on project commitments 1996 drafted by Bruce Perens (as DPL) + discussion 1997 ratified version ratified version 1.1 one of Debian Foundation Documents tacit agreement between Debian and the FOSS community volunteer project very important for developers motivation Stefano Zacchiroli (Debian) Debian Como, Italy 41 / 112

43 Social Contract details We declare that: 1 Debian will remain 100% free We provide the guidelines that we use to determine if a work is free in the document entitled The Debian Free Software Guidelines. We promise that the Debian system and all its components will be free according to these guidelines. We will support people who create or use both free and non-free works on Debian. We will never make the system require the use of a non-free component. Depends: DFSG allow users to live 100% Free digital life... but does not force them to Stefano Zacchiroli (Debian) Debian Como, Italy 42 / 112

44 Social Contract details (cont.) 2 We Will Give Back to the Free Software Community When we write new components of the Debian system, we will license them in a manner consistent with the Debian Free Software Guidelines. We will make the best system we can, so that free works will be widely distributed and used. We will communicate things such as bug fixes, improvements and user requests to the upstream authors of works included in our system. dogfooding commitment to the Free Software ecosystem encourage ecosystem sustainability, rather than Debian s only principle: Free Software success is more important than Debian s Stefano Zacchiroli (Debian) Debian Como, Italy 43 / 112

45 Implied distribution ecosystem shortcut the 1-to-many user-upstream relationship does not hide upstream existence (they re in the social contract!) encourages: contributing distro-originated bugs and fixes upstream software selection and integration at the distro level centralizes user trust on distro editors Stefano Zacchiroli (Debian) Debian Como, Italy 44 / 112

46 Social Contract details (cont.) 3 We Won t Hide Problems We will keep our entire bug report database open for public view at all times. Reports that people file online will promptly become visible to others. historically relevant: first community distro possibly the single greatest Debian contribution to Free Software induced a culture of project-wide transparency folklore: social contract 3 is not only for bugs folklore: there is no cabal con: it is hard, really; makes harder interaction with actors that have different values pro: fundamental for volunteer motivation Stefano Zacchiroli (Debian) Debian Como, Italy 45 / 112

47 Social Contract details (cont.) 4 Our priorities are our users and free software We will be guided by the needs of our users and the free software community. We will place their interests first in our priorities. [... ] We will not object to non-free works that are intended to be used on Debian systems, or attempt to charge a fee to people who create or use such works. We will allow others to create distributions containing both the Debian system and other works, without any fee from us. [... ] attempted balance: user and free software interests often at stake: non-free graphic/network drivers in Debian? first glimpses of pragmatism: the real world is what it is Stefano Zacchiroli (Debian) Debian Como, Italy 46 / 112

48 Social Contract details (cont.) 5 Works that do not meet our free software standards We acknowledge that some of our users require the use of works that do not conform to the Debian Free Software Guidelines. We have created contrib and non-free areas in our archive for these works. The packages in these areas are not part of the Debian system, although they have been configured for use with Debian. We encourage CD manufacturers to read the licenses of the packages in these areas and determine if they can distribute the packages on their CDs. Thus, although non-free works are not a part of Debian, we support their use and provide infrastructure for non-free packages (such as our bug tracking system and mailing lists). Debian pragmatism at its peek enabled to attract a vast non ideological community Stefano Zacchiroli (Debian) Debian Como, Italy 47 / 112

49 Debian Free Software Guidelines (DFSG) the Social Contract relies on a definition of Free Software the other Debian Foundation Document guidelines only not hard rules used to help decide what is part of Debian apply to the freedoms attached to a given package usually: copyright license but also: trademark license, and your favorite $monopoly have de facto made Debian a renowned authority about software free-ness together with major authorities: FSF, OSI trivia: basis for Open Source Definition / Initiative Stefano Zacchiroli (Debian) Debian Como, Italy 48 / 112

50 DFSG details 1 Free Redistribution The license of a Debian component may not restrict any party from selling or giving away the software as a component of an aggregate software distribution containing programs from several different sources. The license may not require a royalty or other fee for such sale. Free Software freedom 2: redistribute copies Stefano Zacchiroli (Debian) Debian Como, Italy 49 / 112

51 DFSG details 2 Source Code The program must include source code, and must allow distribution in source code as well as compiled form. explicit the open source requirement of freedoms 1 (study) and 3 (distribute modifications) open source heritage of those days, then become part of its definition 3 Derived Works The license must allow modifications and derived works, and must allow them to be distributed under the same terms as the license of the original software. Free Software freedom 3 (distribute modifications) Stefano Zacchiroli (Debian) Debian Como, Italy 50 / 112

52 DFSG details 2 Source Code The program must include source code, and must allow distribution in source code as well as compiled form. explicit the open source requirement of freedoms 1 (study) and 3 (distribute modifications) open source heritage of those days, then become part of its definition 3 Derived Works The license must allow modifications and derived works, and must allow them to be distributed under the same terms as the license of the original software. Free Software freedom 3 (distribute modifications) Stefano Zacchiroli (Debian) Debian Como, Italy 50 / 112

53 DFSG details (cont.) 4 Integrity of The Author s Source Code The license may restrict source-code from being distributed in modified form only if the license allows the distribution of patch files with the source code for the purpose of modifying the program at build time. The license must explicitly permit distribution of software built from modified source code. The license may require derived works to carry a different name or version number from the original software. But: trademarks are not (necessarily) incompatible with software freedoms (This is a compromise. The Debian group encourages all authors not to restrict any files, source or binary, from being modified.) Stefano Zacchiroli (Debian) Debian Como, Italy 51 / 112

54 DFSG details (cont.) 5 No Discrimination Against Persons or Groups The license must not discriminate against any person or group of persons. 6 No Discrimination Against Fields of Endeavor The license must not restrict anyone from making use of the program in a specific field of endeavor. For example, it may not restrict the program from being used in a business, or from being used for genetic research. Exercise (Free Software ethics) Why a license that states the software cannot be used for warfare purposes is unacceptable from the Free Software point of view? What would be the loss for the Free Software ecosystem? Stefano Zacchiroli (Debian) Debian Como, Italy 52 / 112

55 DFSG details (cont.) 5 No Discrimination Against Persons or Groups The license must not discriminate against any person or group of persons. 6 No Discrimination Against Fields of Endeavor The license must not restrict anyone from making use of the program in a specific field of endeavor. For example, it may not restrict the program from being used in a business, or from being used for genetic research. Exercise (Free Software ethics) Why a license that states the software cannot be used for warfare purposes is unacceptable from the Free Software point of view? What would be the loss for the Free Software ecosystem? Stefano Zacchiroli (Debian) Debian Como, Italy 52 / 112

56 DFSG details (cont.) 7 Distribution of License The rights attached to the program must apply to all to whom the program is redistributed without the need for execution of an additional license by those parties. i.e. license applies by default, no need to execute anything Stefano Zacchiroli (Debian) Debian Como, Italy 53 / 112

57 DFSG details (cont.) 8 License Must Not Be Specific to Debian The rights attached to the program must not depend on the program s being part of a Debian system. If the program is extracted from Debian and used or distributed without Debian but otherwise within the terms of the program s license, all parties to whom the program is redistributed should have the same rights as those that are granted in conjunction with the Debian system. no special casing: it is free for us only if it is free for everybody coherent with the Free Software first view Stefano Zacchiroli (Debian) Debian Como, Italy 54 / 112

58 DFSG details (cont.) 9 License Must Not Contaminate Other Software The license must not place restrictions on other software that is distributed along with the licensed software. For example, the license must not insist that all other programs distributed on the same medium must be free software. license modularity ancillary clause to ensure Debian can be distributed on media Stefano Zacchiroli (Debian) Debian Como, Italy 55 / 112

59 Debian Free Software (?) Guidelines Spot the differences! Debian Will Remain 100% Free Software (SC 1.0) We promise to keep the Debian GNU/Linux Distribution entirely free software. As there are many definitions of free software, we include the guidelines we use to determine if software is free below. We will support our users who develop and run non-free software on Debian, but we will never make the system depend on an item of non-free software. vs Debian will remain 100% free (SC 1.1) We provide the guidelines that we use to determine if a work is free in the document entitled The Debian Free Software Guidelines. We promise that the Debian system and all its components will be free according to these guidelines. We will support people who create or use both free and non-free works on Debian. We will never make the system require the use of a non-free component. Stefano Zacchiroli (Debian) Debian Como, Italy 56 / 112

60 Debian Free Software (?) Guidelines (cont.) SC editorial changes of all content is equal and subject to DFSG no double standard for software documentation firmware data collections... radical position at the time increasingly popular today in the free culture movement objected by major actors (e.g. FSF for political texts) Source of ethical doubts and technical issues within the community for Debian releases up to Squeeze. Today: no non-free firmware in main and no (new) non-free firmware in Linux upstream. Stefano Zacchiroli (Debian) Debian Como, Italy 57 / 112

61 DFSG in practice DFSG are no laws, but guidelines no judges, no tribunals, just judgement (with responsibles in charge) For complex cases, a series of thought experiments have been developed and are used as benchmark for some DFSG features Stefano Zacchiroli (Debian) Debian Como, Italy 58 / 112

62 DFSG thought experiments Example (The Desert Island test) Imagine a castaway on a desert island with a solar-powered computer. This would make it impossible to fulfill any requirement to make changes publicly available or to send patches to some particular place. This holds even if such requirements are only upon request, as the castaway might be able to receive messages but be unable to send them. To be free, software must be modifiable by this unfortunate castaway, who must also be able to legally share modifications with friends on the island. Stefano Zacchiroli (Debian) Debian Como, Italy 59 / 112

63 DFSG thought experiments (cont.) Example (The Desert Island test) Imagine a castaway on a desert island with a solar-powered computer. This would make it impossible to fulfill any requirement to make changes publicly available or to send patches to some particular place. This holds even if such requirements are only upon request, as the castaway might be able to receive messages but be unable to send them. To be free, software must be modifiable by this unfortunate castaway, who must also be able to legally share modifications with friends on the island. Stefano Zacchiroli (Debian) Debian Como, Italy 59 / 112

64 DFSG thought experiments (cont.) Example (The Dissident test) Consider a dissident in a totalitarian state who wishes to share a modified bit of software with fellow dissidents, but does not wish to reveal the identity of the modifier, or directly reveal the modifications themselves, or even possession of the program, to the government. Any requirement for sending source modifications to anyone other than the recipient of the modified binary in fact any forced distribution at all, beyond giving source to those who receive a copy of the binary would put the dissident in danger. For Debian to consider software free it must not require any such excess distribution. Stefano Zacchiroli (Debian) Debian Como, Italy 59 / 112

65 DFSG thought experiments (cont.) Example (The Dissident test) Consider a dissident in a totalitarian state who wishes to share a modified bit of software with fellow dissidents, but does not wish to reveal the identity of the modifier, or directly reveal the modifications themselves, or even possession of the program, to the government. Any requirement for sending source modifications to anyone other than the recipient of the modified binary in fact any forced distribution at all, beyond giving source to those who receive a copy of the binary would put the dissident in danger. For Debian to consider software free it must not require any such excess distribution. Stefano Zacchiroli (Debian) Debian Como, Italy 59 / 112

66 DFSG thought experiments (cont.) Example (The Tentacles of Evil test) Imagine that the author is hired by a large evil corporation and, now in their thrall, attempts to do the worst to the users of the program: to make their lives miserable, to make them stop using the program, to expose them to legal liability, to make the program non-free, to discover their secrets, etc. The same can happen to a corporation bought out by a larger corporation bent on destroying free software in order to maintain its monopoly and extend its evil empire. The license cannot allow even the author to take away the required freedoms! Stefano Zacchiroli (Debian) Debian Como, Italy 59 / 112

67 DFSG thought experiments (cont.) Example (The Tentacles of Evil test) Imagine that the author is hired by a large evil corporation and, now in their thrall, attempts to do the worst to the users of the program: to make their lives miserable, to make them stop using the program, to expose them to legal liability, to make the program non-free, to discover their secrets, etc. The same can happen to a corporation bought out by a larger corporation bent on destroying free software in order to maintain its monopoly and extend its evil empire. The license cannot allow even the author to take away the required freedoms! Stefano Zacchiroli (Debian) Debian Como, Italy 59 / 112

68 DFSG vs common licenses some DFSG-free licenses: strong copyleft licenses: GPL, AGPL, (CC BY-SA 3.0,)... weak copyleft licenses: LGPL, MPL liberal license: BSD, MIT/X11, Apache,... some non-dfsg-free licenses: all the bad ones Stefano Zacchiroli (Debian) Debian Como, Italy 60 / 112

69 DFSG exercises Exercise Which of the following Creative Commons licenses is DFSG-free? CC BY creativecommons.org/ licenses/ by/ 3.0/ CC BY-ND creativecommons.org/ licenses/ by-nd/ 3.0/ CC BY-NC-SA creativecommons.org/ licenses/ by-nc-sa/ 3.0/ Exercise Is the TeX license DFSG-free? en.wikipedia.org/ wiki/ TeX#License Exercise Is the GNU Free Documentation License DFSG-free? copyleft/ fdl.html Stefano Zacchiroli (Debian) Debian Como, Italy 61 / 112

73 Constitution structure and rules for decision making in a Free Software-compatible democracy volunteers minimal people management do-ocracy anybody can decide how to do their job nobody can impose to others what to do relationships with the real fiscal world Stefano Zacchiroli (Debian) Debian Como, Italy 63 / 112

74 Constitution changelog Need: project-wide decisions Solution: project-wide voting (AKA general resolution) 1998 drafted by Ian Jackson (as DPL) + discussion 1998 v1.0: ratified 2003 v1.1: clarify voting method: Condorcet/clone proof SSD 2003 v1.2: clearly define foundation documents 2006 v1.3: generalize asset management 2007 v1.4: reduce the length of DPL election Note: equipped with typical constitutional self-defense mechanisms. All changes above needed to pass, and obtained, 3:1 majority Stefano Zacchiroli (Debian) Debian Como, Italy 64 / 112

75 Constitution bodies individual developers (or, better, project members) Debian Project Leader (DPL) elected each year technical committee (tech-ctte) secretary trusted organizations Stefano Zacchiroli (Debian) Debian Como, Italy 65 / 112

76 Project members akin to Debian Project citizens everybody can work on Debian without being a project member... but project members do have specific rights: voting (and being voted) right to use project technical infrastructure upload access to the official archive (for packagers) Stefano Zacchiroli (Debian) Debian Como, Italy 66 / 112

77 Project leader represents Debian delegates area of ongoing responsibility to developers AKA appoint delegates coordinate project activities, lead discussions decide upon project assets money hardware IP, e.g. trademarks decision garbage collector urgency lack of other responsibles Stefano Zacchiroli (Debian) Debian Como, Italy 67 / 112

78 Technical committee tribunal for technical disputes, 4 8 members the only formalized dispute resolution body in Debian everything else (e.g. social issues) dealt with via mediation often by the DPL members: skilled, (project-)elderly, well-respected developers appointed by DPL formal voting process that mimics project-wide votes Example (some recent tech-ctte issues) # node: name conflicts with node.js interpreter # Please decide how Debian should enable hardening build flags # GNU parallel, name conflict with moreutils # Please decide on Python interpreter packages maintainership Stefano Zacchiroli (Debian) Debian Como, Italy 68 / 112

79 Constitution decision making golden rule do-ocracy, no formal process formally, decisions are taken by: 1 1 developers as a whole with general resolutions or elections 2 the DPL 3 the technical committee (CTTE) 4 individual developers working on some task default 5 DPL delegates 6 the project secretary 1 overruling from top to bottom Stefano Zacchiroli (Debian) Debian Como, Italy 69 / 112

80 General resolutions decision making heavy weapon, not to be abused used for project-wide decisions and position statement folklore: thou shalt not use GRs for technical decisions 1 initial proposal post to the debian-vote mailing list requires seconds, depend on n. of developer 2 discussion period might lead to alternative proposals can put on hold decisions of any body 3 vote with Condorcet-based method 4 single winner super majority (3:1) required to change Foundation Documents and Constitution Stefano Zacchiroli (Debian) Debian Como, Italy 70 / 112

81 Voting method Definition (Condorcet winner) foo A candidate that would win majority against any single other candidate. If there is a Condorcet winner, it will win in any Condorcet method election Debian: Schulze method (most popular Condorcet method) bar baz Sample ballot: [4] bar [2] baz [1] foo [2] quux [3] None Of The Above 336 None Of The Above 34 quux 1.19 Figure: foo has won! Stefano Zacchiroli (Debian) Debian Como, Italy 71 / 112

82 Secretary appointed conjointly by DPL and incumbent secretary responsible for election procedures de facto authority for Constitution interpretation in electoral matters maintains and run the voting software devotee voting artifacts (software, ballots, etc.) available for review software allows to rerun and verify election results, e.g.: Pop quiz: e-voting would you run your country s election this way? Stefano Zacchiroli (Debian) Debian Como, Italy 72 / 112

83 Secretary appointed conjointly by DPL and incumbent secretary responsible for election procedures de facto authority for Constitution interpretation in electoral matters maintains and run the voting software devotee voting artifacts (software, ballots, etc.) available for review software allows to rerun and verify election results, e.g.: Pop quiz: e-voting would you run your country s election this way? Stefano Zacchiroli (Debian) Debian Como, Italy 72 / 112

84 Fiscal sponsorship Do Free Software projects exist in the real world, the one made of money, laws (and lawyers), taxes, etc? They do have needs that relate them to it, e.g.: receive (tax exempt) donations... and provide (tax deductible) receipts own hardware, potentially expensive Debian hardware cost per year: USD own copyright and trademarks that might want/need to enforce... use donated money to reimburse or pay developers developers might get sued $evil_proprietary_software_company patent trolls... Stefano Zacchiroli (Debian) Debian Como, Italy 73 / 112

85 Fiscal sponsorship Do Free Software projects exist in the real world, the one made of money, laws (and lawyers), taxes, etc? They do have needs that relate them to it, e.g.: receive (tax exempt) donations... and provide (tax deductible) receipts own hardware, potentially expensive Debian hardware cost per year: USD own copyright and trademarks that might want/need to enforce... use donated money to reimburse or pay developers developers might get sued $evil_proprietary_software_company patent trolls... Stefano Zacchiroli (Debian) Debian Como, Italy 73 / 112

86 Fiscal sponsorship (cont.) Definition (Fiscal sponsorship) Fiscal sponsorship is the practice of non-profit organizations (NPO) to offer legal and tax-exempt status to groups related to the organization s missions. By extension, in Free Software it commonly refers to providing all the real world -related needs that a project needs. high-profile FOSS projects have set up their own NPO but it is a lot of work!... and hackers are not necessarily good at it umbrella organizations that do fiscal sponsorship for Free Software projects are more and more common, e.g.: Software Freedom Conservancy, Software in the Public Interest (SPI), (Apache Software Foundation, Stefano Zacchiroli (Debian) Debian Como, Italy 74 / 112

87 Trusted Organization 1997 Debian founds SPI for the needs of Free Software projects including Debian itself, but with the usual give back intent 1998 the Constitution entrusts SPI to handle Debian assets 2006 Constitution amended to not special case SPI introducing the notion of... Trusted Organizations (TO): hold assets in trust for the Project DPL as liaison / decision maker link with the real bureaucratic world donations, legal advice, tax exemption, reimbursements,... SPI (us), FFIS (de), debian.ch (ch), Assoli (it), ASL (br),... Stefano Zacchiroli (Debian) Debian Como, Italy 75 / 112

88 Day to day organization: teams! Luckily, day to day organization is much easier and more informal: teams grow as jobs get bigger some core teams are DPL delegates, most are not examples packaging teams for related packages ftp-master release team security team kernel team debian-installer debian-cd... Stefano Zacchiroli (Debian) Debian Como, Italy 76 / 112

89 Joining an ethical moment 1993 as most FOSS projects, Debian incubated as 1-man-show 1994 Debian manifesto to explain Debian values easy to join: send a mail! ethic crisis small numbers, project members in the tens we need manpower! new developers accepted too quickly disagreement on core values to be more competitive with other distros, we should accept non-free components (lack of needed technical skills) Debian Account Manager (DAM) stops accepting new members Stefano Zacchiroli (Debian) Debian Como, Italy 77 / 112

90 Joining an ethical moment (cont.) 1999 creation of the NM (New Maintainer) process and NM team to accept new members DPL stated requirements to be on the NM team (excerpt): - needs to have a *strong* opinion for free software - needs to have a *strong* opinion for free software - he needs to know what he s doing, that new people need some guidance, we have to prevent ourselves from trojans, etc. - we need to trust him more than we trust *any* other active person - he *has to* understand that new-maintainer is *more* than just creating dumb accounts on N machines References Gabriella Coleman, Three Ethical Moments in Debian, Stefano Zacchiroli (Debian) Debian Como, Italy 78 / 112

91 NM Process 1 identification via GPG key, available in the Web of Trust (WoT) signed by at least 2 project members correspondence: Internet identity real person Debian people: largest connected group in the WoT 2 assignment of an Application Manager (AM) both mentoring and examination requirement: not a newbie project member 3 philosophy & procedures adherence to project core values license/legal knowledge knowledge of common procedures Q&A via Stefano Zacchiroli (Debian) Debian Como, Italy 79 / 112

92 NM Process (cont.) 4 tasks and skills technical (packaging or other) ability with evidence of previous work trivial 5 DAM review & approval DAMs are DPL delegates, (indirect) formal blessing of new members by the Project as a whole special casing in the Constitution: 6 account creation Leader s Delegates [... ] may make certain decisions which the Leader may not make directly, including approving or expelling Developers and setup of related permissions Stefano Zacchiroli (Debian) Debian Como, Italy 79 / 112

93 Diversity The Debian Project is an association of individuals who have made common cause to create a free operating system. but you have the New (Package) Maintainer process is that a problem? Yes technical: there s much more than packaging to a Free OS translation, infrastructure, porting, bug triaging, artwork, communication, management, testing, legal advice, QA,... ethical: first/second class citizen split no sense of belonging for non-packagers results in lack of motivation Stefano Zacchiroli (Debian) Debian Como, Italy 80 / 112

94 Diversity The Debian Project is an association of individuals who have made common cause to create a free operating system. but you have the New (Package) Maintainer process is that a problem? Yes technical: there s much more than packaging to a Free OS translation, infrastructure, porting, bug triaging, artwork, communication, management, testing, legal advice, QA,... ethical: first/second class citizen split no sense of belonging for non-packagers results in lack of motivation Stefano Zacchiroli (Debian) Debian Como, Italy 80 / 112

95 Diversity (cont.) 2010 GR Debian project members to become a Project member, all contributions count rename: New Maintainer (NM) Process New Member 2012 GR Diversity statement The Debian Project welcomes and encourages participation by everyone. No matter how you identify yourself or how others perceive you: we welcome you. We welcome contributions from everyone as long as they interact constructively with our community. While much of the work for our project is technical in nature, we value and encourage contributions from those with expertise in other areas, and welcome them into our community. Stefano Zacchiroli (Debian) Debian Como, Italy 81 / 112

96 Diversity (cont.) 2010 GR Debian project members to become a Project member, all contributions count rename: New Maintainer (NM) Process New Member 2012 GR Diversity statement The Debian Project welcomes and encourages participation by everyone. No matter how you identify yourself or how others perceive you: we welcome you. We welcome contributions from everyone as long as they interact constructively with our community. While much of the work for our project is technical in nature, we value and encourage contributions from those with expertise in other areas, and welcome them into our community. Stefano Zacchiroli (Debian) Debian Como, Italy 81 / 112

97 Organization putting it all together elect Developers Officers Users appoints Project leader appoints Technical committee appoints/approves Project secretary Delegates Release team apply DAM NM team / advocates applicants FTP masters approve Security team Policy group Maintainers / porters Press contacts Web/list/...masters Documentation / i18n teams Administrators CD team Quality assurance etc. etc. etc. Software in the Public Interest (SPI) Stefano Zacchiroli (Debian) Debian Como, Italy 82 / 112