I Using Metrics to Manage
|
|
- Douglas Dixon
- 8 years ago
- Views:
Transcription
1 x Using Metrics to Manage Software Projects Edward E Weer Bu HN nformation Systems* n 1989, Bu s Arizona faciity aunched a project management program that required additiona software metrics and inspections. Today, the company enjoys improvements in quaity, productivity, and cost. September 1994 ive years ago, Bu s Enterprise Servers Operation in Phoenix, Arizona, used a software process that, athough understandabe, was unpredictabe in terms of product quaity and deivery schedue. The process generated products with unsatisfactory quaity eves and required significant extra effort to avoid major schedue sips. A but the smaest software projects require metrics for effective project management. Hence, as part of a program designed to improve the quaity, productivity, and predictabiity of software deveopment projects, the Phoenix operation aunched a series of improvements in One improvement based software project management on additiona software measures. Another introduced an inspection program, since inspection data was essentia to project management improvements. Project sizes varied from severa thousand ines of code (KLOC) to more than 300 KLOC. The improvement projects enhanced quaity and productivity. n essence, Bu now has a process that is repeatabe and manageabe, and that deivers higher quaity products at ower cost. n this artice, describe the metrics we seected and impemented, iustrating with exampes drawn from severa deveopment projects. Project management eves There are three eves of project management capabiity based on softwaremetrics visibiity. (These three eves shoudn t be equated with the five eves in the Software Engineering nstitute s Capabiity Maturity Mode.) Describing them wi put the Bu exampes in perspective and show how we enhanced our process through gathering, anayzing, and using data to manage current projects and pan future ones. First eve. n the simpest terms, software deveopment can be modeed as shown in Figure 1. Effort, in terms of peope and computer resources, is put into a process that yieds a product. A too often, unfortunatey, the process can ony be described * Since writing this artice, the author has joined Motoroa. 001% /$ EEE 27
2 Figure 1. Sottwn pment eve 1: no contro of the deveopment process. Some amount of effort goes into the process. and a product of indeterminant size and quaib is deveoped eary or (usuay) ate. compared to the pan. Figure 3. Software deveopment at eve 2: measurement of the code and test phases begins. Figure 4. Software deveopment eve 3: contro of the entire deveopment process. You measure the requirements and design process to provide feedforward to the rest of the deveopment f Feedback ~ A A...!.-W Fe&forward j i as we as feedback to future panning activities. Figure 2. Defect discovery p&fie for ower deveopment eves. The number of defects in the product exceeds the abiity of imited resources to discover and fix defects. Once the defect number has been reduced sufficienty, the discoven- rate decines toward zero. Predicting when the knee wi occur is the chaenge. by the question mark in Figure 1. Project managers and deveopment staff do not pan the acti\-ities or coect the metrics that woud aow them to contro their project. Second eve. The process depicted in Figure 1 rarey works for an organization de\ eoping operating-system software or arge appications. There is usuay some form of contro in the process. We coected test defect data in integration and system test for many years for severa arge system reeases. and we deveoped profies for defect remova that aowed us to predict the number of weeks remaining before test-cyce competion. The profie was typicay fat for many weeks (or months. for arger system reeases in the OO- to 300.KLOC range) unti we reached a knee in the profie where the defect discovery rate dropped toward zero (see Figure 2). Severa factors imit the defect discovery rate: Defects have a higher probabiity of being bocking defects, which prebent other test execution eary in the integration- and system-test cyce.. The defect discovery rate exceeds the deveopment staff s capacity to anayze and fix probems, as test progresses and more test scenarios can be run in parae. Athough this process gave us a fairy predictabe deivery date once the knee was reached, we coud not predict when the knee woud occur. There were sti too many variabes (as represented by the first two boxes in Figure 3). There was no instrumentation on the requirements or design stages (the? in Figure 3). Our attempts to count or measure the size of the coding effort were. in a sense, counterproductive. The focus of the deveopment effort was on coding because code competed and into test was a countabe, measurabe eement. This ed to a syndrome we caed WSCY for Why isn t Sam coding yet? We didn t know how to measure requirements anaysis or design output. other than by document size. We aso didn t know how to estimate the number of defects entering into test. Hence, there was no way to te how many weeks we woud spend on the fat part of the defect-remova profie. Predicting deivery dates for arge product reeases with 200 to 300 KLOC of new and changed source code was difficut. at best. A ist of measures is avaiabe in the second-eve mode (Figure 3): effort in person-months, computer resources used, the product size when shipped, and the number of defects found in the integration and system tests. Athough these measures are avaiabe, we found them difficut to use in project panning - there was itte correation among the data. and the data was not avaiabe at the right time (for instance. code size wasn t known unti the work was competed). Project managers needed a way to predict and measure what they were panning. Third eve. The key eement of the initiative was to be abe to predict deveopment effort and duration. We chose two measures to add to those we were aready using: (1) size estimates and (2) defect remova for the entire deveopment cyce. Because the inspection program had been in pace since eary 1990, we knew we woud have significant amounts of data on defect remova. Size estimating was more difficut because we had to move from an effort-based estimating system (sometimes biased by avaiabe resources) to one based on quantitative measures that were unfamiiar to most of the staff. The size measures were necessary to derive expected numbers of defects, which then coud be used to predict test schedues with greater accuracy. This data aso provided feedback to the panning organization for future projects. To meet the needs of the mode shown in Figure 4, we needed the foowing measures (itaics designate changes from the prior ist): 8 COMPUTER
3 The sidehar Data cocct~on sheet shows a sampe orm used to compie data. Project panning Once the project team deveops the first six estimate. the project manager xsini; to USL the data ~ as we as his- ~orica data tram our metrics database ~ for cyort and xhcdue estimating. Sevc~-a exampes -oni actua projects iustrate these point\. Using de&t data to pan test activities. u c use the nspection and test defect database\ as the primary defect-cstimation SOWcc. The in\pcction data provides defect detection r;r\ for design and code ~! product idcnti ier (PD). Our test dat;~basc can x \carchcd b\ the same PD. w a defect depetion curve? for the project can be constructed by summarizing a the project s PDs. (Severa interesting exampes in Humphrey provided a tempate for constructing a simpe spreadsheet appication that we used to pan and track defect injection and remova rates.) Figure 5 shows such a curve for one project. The size and defect density estimates were based on experience from a prior project. The project manager estimated thr unit and integration test effort from the defect estimates and the known cost to find and fix defects in test. The estimates and actua amounts are compared in the Project trackins and anaysis s;cction beow. Data coection sheet This ~~a~~if~ sheet, deveoped by Kathy Grif- eements tare estimated Q coieoted at each deveopfit& Software Engkxeering Process Group projeot man- merit-cyce phase, The &is with XX in them indicate data ager at B&k, compie6 effort, size, defect, and competion ooi at the et@ of hiigh-eve design; the &s with YY data. Athough the sheet L somewhat busy, ony six data efe derive4 from the XX data.. DATA COLLECTON SHEET Project Name 1 c 4 Buid Product or Feature Group dentifier(s) (PDs, DS, etc.) Date of nitia Estimates N&C Origina KLOC Est N&C Revised KLOC Est N&C KLOC Actuas Effort - Estimate Effort - Revised (PM) (PM) Effort - Actua (PM) # Defects - Estimate # Defects Actua YY Est Phase End Dates xx GS = Genera Ship HLD = High-Leve Design LLD = Low-Leve Design LEV = Unit. or Leve 1, Test LEV2 = ntegration. or Leve 2. Test LEV3 = System. or Leve 3, Test LEV4 = Beta. or Leve 4. Test N&C = New and Changed PD = Product Dentifier PM = Person Months REQ = Requirements Anaysis
4 Deveopment phase Figure 5. Estimated versus actua defect depetion curves. Mutipe data views. The data in Figure the ater stages of the system test: this 6 heped the project manager anayze re- demonstrated why it s important to ook suts from the integration test. The proj- at more than the tota number of defects ect team had itte experience with the or the defect density, even when the numtype of product to be deveoped, so a ber of defects is beow expectations. A arge number of defects were predicted. coser ook at the eary deveopment The team aso decided to spend more ef- stages shows that very few requirements fort on the unit test. After the unit test, or high-eve design defects were found in the resuts seemed within pan, as shown the inspections. The ow-eve design inin Figure 6a. During the integration test, spections aso found fewer defects than some concern was raised that the num- expected. What the project members ber of defects found was too high. Once missed in the data anaysis during the unit the data was normaized against the proj- and integration tests was the arge numect size and compared to projections for ber of design errors being detected (see the number of defects expected by the Figure 6b). This exampe demonstrates deveopment team, the eve of concern the vaue of independent data coection was owered. and anaysis as soon as it is avaiabe. However, this project had a serious re- An objective anaysis. or at east an quirement error that was discovered in anaysis that ooked at the project from a different viewpoint. might have spotted the anomay. Unit test data accuracy might have been questioned as foows: *Are some of the errors caused by high-eve design defects? Why weren t any design defects found in the integration test? When the data was charted with the defect source added, the design-defect data discovery rate in the unit test was obvious. The inaccuracy of the integration test data aso became apparent. A coser ook at the project reveaed the source of the defect data had not been coected. We aso questioned members of the design inspection teams: we found that key peope were not avaiabe for the high-eve design inspection. As a resut, we changed the entry criteria for oweve design to deay the inspection for two to three weeks, if necessary, to et a key system architect participate in the inspection. Part of the change required a risk anaysis of the potentia for scrubbing the ow-eve design work started before the inspection. Using test cost. On one arge project. the measured cost in the integration test was much higher than expected. Even though you know the cost of defects in test is high. an accurate cost tay can surprise you. f you haven t gathered the data for a project. the foowing exampe may convince you that the effort is worthwhie. On this arge project. it took O- n Phases 0 Coding 0 LLD n HLD n R/A 1 (a) Deveopment phase W Deveopment phase Figure 6. Projected versus actua number of defects found per thousand ines of code from inspections and test (a), and additiona information when the defect source is incuded (b). 30 COMPUTER, DUE TO LACK OF CONTRAST, GRAPHS DD NOT REPRODUCE WELL. GRAF HS FOLLOW SAME SEQUENCE AS LEGEND _~_...~.
5 80 hours to find and fix the typica defect, 03.5 person-months to rebuid the product and rerun the test suite, and 8-10 caendar days to compete the retest cyce. Three months effort represents the fixed cost of test for this product area. This anaysis reemphasizes the need to spend more time and effort on inspecting design and code work products. How many additiona hours shoud be spent inspecting the work products (design, code, and so forth) versus the months of effort expended in test? Tabe 1. Defect density inferences. Defect Density Observation Lower than expected Higher than expected nferences Size estimate is high (good). nspection defect detection is ow (bad). Work product quaity is high (good). nsufficient eve of detai in work product (bad). Size estimate is ow (bad). Work product quaity is poor (bad). nspection defect detection is high (good). Too much detai in work product (good or bad). Sanity check. Size estimates and software deveopment attribute ratings are used as input to the Cocomo (Constructive Cost Mode) estimating model3 (Joe Wiechec of Bu s Reease Management group deveoped a Cocomo spreadsheet appication based on Boehm3 for schedue and effort sanity checks.) The accuracy of the effort estimate produced by Cocomo depends on accurate size estimate and software deveopment attribute ratings (anayst capabiity, programmer capabiity, and so forth). We compare the assumed defect rates and cost to remove these defects with the Cocomo output as a sanity check for the estimating process. Since project managers often assign attribute ratings optimisticay, the defect data based on project and product history provides a crosscheck with the cost for unit and integration test derived from the Cocomo estimate. Reasonabe agreement between Cocomo test-effort estimates and estimates derived from defect density and cost to find and fix per-defect figures confirm that attribute ratings have been reasonaby revised. This sanity check works ony for the attribute ratings, since both the Cocomo effort estimates and test cost estimates depend on the size estimate. Project tracking The keys to good project tracking are defining measurabe and countabe entities and having a repeatabe process for gathering and counting. During the design phase, the metrics avaiabe to the project manager are effort spent in person-months, design-document pages, and defects found via work product re- view, inspection, or use in subsequent deveopment stages. nterpreting effort variance. When effort expenditures are beow pan, the project wi typicay be behind schedue because the work simpy isn t getting done. An aternative expanation might be that the design has been competed, but without the detai eve necessary to progress to the next deveopment phase. This merey sets the stage for disaster ater. We use inspection defect data from design inspection to guard against such damaging situations. f the density fas beow a ower imit of 0.1 to 0.2 defects per page versus an expected 0.5 to 1.0 defects per page, the possibiity increases that the document is incompete. When defect detection rates are beow 0.5 defects per page, the preparation and inspection rates are examined to verify that sufficient time was spent in document inspection. We aso cacuate the inspection defect density using the number of major defects and the estimated KLOC for the project. f the defect density is ower than expected, either the KLOC estimate is high or the detai eve in the work product is insufficient (see Tabe 1). When trying to determine which of the eight possibe outcomes refect the project status, project managers must draw on their experience and their team and product knowedge. beieve the project manager s abiity to evauate the team s inspection effectiveness wi be better than the team s abiity to estimate the code size. n particuar, a 2-to-1 increase in detection effectiveness is far ess ikey than a 2-to-1 error in size estimating. When effort expenditures are above the pan and work product deiverabes are on or behind schedue, the size estimate was ceary ower than it shoud have been. This aso impies ater stages wi require more effort than was panned. n both cases, we found that the process instrumentation provided by inspections was very usefu in vaidating successfu design competion. The famiiar 90 percent done statements have disappeared. nspections are a visibe, measurabe gate that must be passed. Project tracking and anaysis. nspection defect data adds severa dimensions to the project manager s abiity to evauate project progress. Gass4 and Graham5 caim that defects wi aways be a part of the initia deveopment effort. (Gass says design defects are the resut of the cognitive/creative design process, and Graham says errors are inevitabe, not sinfu, and unintentiona. ) Humphrey presents data indicating that injection rates of 100 to 200 defects per KLOC of deivered code are not unusua.6 Athough we have seen a 7-to-1 difference in defect injection rates between projects, the variance is much ess for simiar projects. For the same team doing simiar work, the defect injection rate is neary the same. The project anayzed in Figure 5 invoved a second-generation product deveoped by many of the peope who worked on the first-generation product. At the end of the ow-eve design phase, Steve Magee, the project manager, noticed a significant difference in the estimated and actua defect-depetion counts for ow-eve design defects. The estimate was derived from the earier project, which featured many simiar characteristics. There was a significant increase in the actua defect data. We September
6 Tabe 2. Measures and possibe inferences during requirements Measure Vaue nference and design phases. Effort Above pan Project is arger than panned, if not ahead of schedue; or project is more compex than panned, if on schedue. Defects Detected Beow pan Above pan Beow pan Project is smaer than estimated, if on schedue; or project is behind schedue; or design detai is insufficient, if on or ahead of schedue. Size of project is arger than panned; or quaity is suspect; or inspection detection effectiveness is better than expected. nspections are not working as we as expected; or design acks sufficient content; or size of project is smaer than panned; or quaity is better than expected. Size Above pan Marketing changes or project compexity are growing - more resource or time wi be needed to compete ater stages. Beow pan aso had some numbers from the first project that suggested inspection effectiveness (defects found by inspection divided by the tota number of defects in the work product) was in the 75 percent range for this team. Again, we were abe to use our inspection data to infer severa theories that expained the differences. The defect shift from code to ow-eve design coud be attributed to finding defects in the ow- Project is smaer than estimated; or something has been forgotten. Dewbmmt eve design inspections on the second project, rather than during code inspections in the first project. A coser ook at the first project defect descriptions from code inspections reveaed that a third of the defects were missing functionaity that coud be traced to the ow-eve design, even though many defects had been incorrecty tagged as coding errors. Reevauating the detaied defect descriptions brought out an important fact: phase Figure 7. Actua defect density data for the project depicted in Figure 5. The percentage of design defects detected in code inspection on the first project was higher than we thought. We were aso concerned by the number of defects, which exceeded the tota we had estimated even after accounting for the earier detection. t seemed more ikey that the size estimate was ow rather than that there was a significant increase in defect detection effectiveness. n fact, the size estimate was about 50 percent ow at the beginning of oweve design. The project manager adjusted his size estimates and consequenty was better abe to predict unit test defects when code inspections were in progress, and time for both unit and integration test. Using defect data heped the project manager determine that design defects were being discovered earier and project size was arger than expected. Hence, more coding effort and unit and integration test time woud be needed. Figure 7 shows the actua data as this project entered system test. Comparing the data in Figures 5 and 7 indicates a shift in defect detection to earier stages in the deveopment cyce; hence, the project team is working more effectivey. D efect data can be used as a key eement to improve project panning. Once a size estimate is avaiabe, historica data can be used to estimate the number of defects expected in a project, the deveopment phase where defects wi be found, and the cost to remove the defects. Once the defect-depetion curve for the project is deveoped, variances from the predictions provide indicators that project managers can examine for potentia troube spots. Tabe 2 summarizes these measures, their vaue (above or beow pan), and the possibe troubes indicated. These measures and those isted in Tabe 1 answer many of the questions in the design box in Figure 3. One difficuty project managers must overcome is the unwiingness of the deveopment staff to provide defect data. Grady mentions the concept of pubic versus private data, particuary regarding inspection-data usage. Uness the project team is comfortabe with making this data avaiabe to the project manager, it is difficut to gather and anayze the data in time for effective use. beieve that continuing education on the pervasiveness of defects, and recog- 13 JL _. U-M- DUE TO LACK OF CONTRAST, GRAPHS DD NOT REPRODUCE WELL. GRAF HS FOLLOW SAME SEQUENCE AS LEGEND.- COMPUTER.--
7 nition that defects are a norma occurrence in software deveopment, is a critica first step in using defect data more effectivey to measure deveopment progress and product quaity. Ony through coecting and using defect data can we better understand the nature and cause of defects and utimatey improve product quaity. n Acknowedgments thank John T. Harding and Ron Radice for their many hours of discussion on defect remova as a project management too; Steve Magee, Fred Kuhman, and Ann Hoaday for their wiingness to use the methods described in this artice on their projects; Jean-Yves LeGoic for his exceent critique; Barbara Ahstrand, Robin Fuford, and George Mann for inspecting the manuscript; and the anonymous referees for their hepfu recommendauons.,. References 1. E. Weer, Lessons from Three Years of nspection Data, EEE Software, Vo. 10, No. 5, Sept. 1993, pp W. Humphrey, Managing the Software Process, 1990, Addison-Wesey, Reading, Mass., pp B.W. Boehm, Software Engineering Economics, Prentice Ha, Engewood Ciffs, N.J R. Gass, Persistent Software Errors: 10 Years Later, Proc. First nt Software Test, Anaysis, and Rev. Conf.. Software Quaity Engineering, Jacksonvie, Fa., D. Graham, Test s a Four Letter Word: The Psychoogy of Defects and Detection, Proc. First nt Software Testing, Anaysis, and Rev. Conf, 1992, Software Quaity Engineering, Jacksonvie, Fa. 6. W. Humphrey, The Persona Software Process Paradigm, Sixth Software Eng. Process Grouo Nat 1 Meetinp. Software Eng. nst., Carnegie Meon Univ., Pittsburgh, Edward F. Weer is a technica staff engineer at Motoroa s Sateite Communications Division, where he is responsibe for deveoping software subcontract management processes. Previousy, he was the software process architect for the Bu HN nformation System s Mainframe Operating Systems Group. Weer received a BSEE from the University of Michigan and an MSEE from the Forida nstitute of Technoogy. He was awarded Artice of the Year honors in 1993 by EEE Software for authoring Lessons from Three Years of nspection Data. He is a member of the Software Engineering nstitute s Software Measurements Steering Committee and is co-chair of the Software nspection and Review Organization, a specia-interest group promoting inspection process usage. He is a senior member of the EEE and a member of the EEE Computer Society.. R. Grady, Practica Software Metrics For Readers can contact Weer at Motoroa Project Management and Process m- Government Systems and Technoogy, 2501 S. provement, Prentice Ha, Engewood Price Rd., MS G1137, Chander, AZ Ciffs, N.J., 1992, pp , e-mai ed-weer-p26708@emai.mot.com. Does Your Software Have Bugs? You need nsight A source-eve automatic runtime debugger for C and Ctt /bght++ automaticay detects on average 30% more bugs than other debuggers, heping you to produce higher quaity software faster. For a imited time, get a mutiuser icense for ony $1495 or ca for a free tria. nsight++ finds a bugs reated to: d memory corruption dynamic, static/goba, and stack/oca (/ memory eaks (/ memory aocation new and deete (/ /O errors (/ pointer errors Avaiabe for Sun, SG, DEC, / ibrary function cas HP9000, BM RS/6000, and mismatched arguments others. invaid parameters ParaSoft Corporation Phone: (818) FAX: (818) E-mai: insight@parasoft.com Web: Reader Service Number 3 --T -
3.3 SOFTWARE RISK MANAGEMENT (SRM)
93 3.3 SOFTWARE RISK MANAGEMENT (SRM) Fig. 3.2 SRM is a process buit in five steps. The steps are: Identify Anayse Pan Track Resove The process is continuous in nature and handed dynamicay throughout ifecyce
More informationOrder-to-Cash Processes
TMI170 ING info pat 2:Info pat.qxt 01/12/2008 09:25 Page 1 Section Two: Order-to-Cash Processes Gregory Cronie, Head Saes, Payments and Cash Management, ING O rder-to-cash and purchase-topay processes
More informationChapter 2 Traditional Software Development
Chapter 2 Traditiona Software Deveopment 2.1 History of Project Management Large projects from the past must aready have had some sort of project management, such the Pyramid of Giza or Pyramid of Cheops,
More informationBite-Size Steps to ITIL Success
7 Bite-Size Steps to ITIL Success Pus making a Business Case for ITIL! Do you want to impement ITIL but don t know where to start? 7 Bite-Size Steps to ITIL Success can hep you to decide whether ITIL can
More informationAustralian Bureau of Statistics Management of Business Providers
Purpose Austraian Bureau of Statistics Management of Business Providers 1 The principa objective of the Austraian Bureau of Statistics (ABS) in respect of business providers is to impose the owest oad
More informationTeamwork. Abstract. 2.1 Overview
2 Teamwork Abstract This chapter presents one of the basic eements of software projects teamwork. It addresses how to buid teams in a way that promotes team members accountabiity and responsibiity, and
More informationAdvanced ColdFusion 4.0 Application Development - 3 - Server Clustering Using Bright Tiger
Advanced CodFusion 4.0 Appication Deveopment - CH 3 - Server Custering Using Bri.. Page 1 of 7 [Figures are not incuded in this sampe chapter] Advanced CodFusion 4.0 Appication Deveopment - 3 - Server
More informationPREFACE. Comptroller General of the United States. Page i
- I PREFACE T he (+nera Accounting Office (GAO) has ong beieved that the federa government urgenty needs to improve the financia information on which it bases many important decisions. To run our compex
More informationEarly access to FAS payments for members in poor health
Financia Assistance Scheme Eary access to FAS payments for members in poor heath Pension Protection Fund Protecting Peope s Futures The Financia Assistance Scheme is administered by the Pension Protection
More informationLet s get usable! Usability studies for indexes. Susan C. Olason. Study plan
Let s get usabe! Usabiity studies for indexes Susan C. Oason The artice discusses a series of usabiity studies on indexes from a systems engineering and human factors perspective. The purpose of these
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow some of which may not appy your account Some of these may
More informationIT Governance Principles & Key Metrics
IT Governance Principes & Key Metrics Smawood Maike & Associates, Inc. 9393 W. 110th Street 51 Corporate Woods, Suite 500 Overand Park, KS 66210 Office: 913-451-6790 Good governance processes that moves
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow some of which may not appy your account Some of these may
More informationWHITE PAPER BEsT PRAcTIcEs: PusHIng ExcEl BEyond ITs limits WITH InfoRmATIon optimization
Best Practices: Pushing Exce Beyond Its Limits with Information Optimization WHITE Best Practices: Pushing Exce Beyond Its Limits with Information Optimization Executive Overview Microsoft Exce is the
More informationA Description of the California Partnership for Long-Term Care Prepared by the California Department of Health Care Services
2012 Before You Buy A Description of the Caifornia Partnership for Long-Term Care Prepared by the Caifornia Department of Heath Care Services Page 1 of 13 Ony ong-term care insurance poicies bearing any
More informationChapter 3: e-business Integration Patterns
Chapter 3: e-business Integration Patterns Page 1 of 9 Chapter 3: e-business Integration Patterns "Consistency is the ast refuge of the unimaginative." Oscar Wide In This Chapter What Are Integration Patterns?
More informationVital Steps. A cooperative feasibility study guide. U.S. Department of Agriculture Rural Business-Cooperative Service Service Report 58
Vita Steps A cooperative feasibiity study guide U.S. Department of Agricuture Rura Business-Cooperative Service Service Report 58 Abstract This guide provides rura residents with information about cooperative
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l l. l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow, some of which may not appy your account Some of these
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l. l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow some of which may not appy your account Some of these may
More informationELECTRONIC FUND TRANSFERS. l l l. l l. l l l. l l l
Program Organization = Number "1060" = Type "123342" = "ETM2LAZCD" For = "502859" "TCCUS" "" Name "WK Number = Name "First "1001" = "1" Eectronic = "1001" = Financia "Jane Funds Doe" Northwest Xfer PG1
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l. l l. l l. l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow some of which may not appy your account Some of these may
More informationArt of Java Web Development By Neal Ford 624 pages US$44.95 Manning Publications, 2004 ISBN: 1-932394-06-0
IEEE DISTRIBUTED SYSTEMS ONLINE 1541-4922 2005 Pubished by the IEEE Computer Society Vo. 6, No. 5; May 2005 Editor: Marcin Paprzycki, http://www.cs.okstate.edu/%7emarcin/ Book Reviews: Java Toos and Frameworks
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES
About ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow, some of which may not appy your account. Some of
More informationThe eg Suite Enabing Rea-Time Monitoring and Proactive Infrastructure Triage White Paper Restricted Rights Legend The information contained in this document is confidentia and subject to change without
More informationThe Web Insider... The Best Tool for Building a Web Site *
The Web Insider... The Best Too for Buiding a Web Site * Anna Bee Leiserson ** Ms. Leiserson describes the types of Web-authoring systems that are avaiabe for buiding a site and then discusses the various
More informationStructural Developments and Innovations in the Asset- Backed Commercial Paper Market
Structura Deveopments and Innovations in the Asset- Backed Commercia Paper arket ark H. Adeson anaging Director, Asset-Backed Commercia Paper oody s Investors Service Strategic Research Institute 1997
More informationLearning from evaluations Processes and instruments used by GIZ as a learning organisation and their contribution to interorganisational learning
Monitoring and Evauation Unit Learning from evauations Processes and instruments used by GIZ as a earning organisation and their contribution to interorganisationa earning Contents 1.3Learning from evauations
More informationREADING A CREDIT REPORT
Name Date CHAPTER 6 STUDENT ACTIVITY SHEET READING A CREDIT REPORT Review the sampe credit report. Then search for a sampe credit report onine, print it off, and answer the questions beow. This activity
More informationChapter 3: Investing: Your Options, Your Risks, Your Rewards
Chapter 3: Investing: Your Options, Your Risks, Your Rewards Page 1 of 10 Chapter 3: Investing: Your Options, Your Risks, Your Rewards In This Chapter What is inside a mutua fund? What is a stock? What
More informationOracle Project Financial Planning. User's Guide Release 11.1.2.2
Orace Project Financia Panning User's Guide Reease 11.1.2.2 Project Financia Panning User's Guide, 11.1.2.2 Copyright 2012, Orace and/or its affiiates. A rights reserved. Authors: EPM Information Deveopment
More informationWEBSITE ACCOUNT USER GUIDE SECURITY, PASSWORD & CONTACTS
WEBSITE ACCOUNT USER GUIDE SECURITY, PASSWORD & CONTACTS Password Reset Process Navigate to the og in screen Seect the Forgot Password ink You wi be asked to enter the emai address you registered with
More informationBusiness Banking. A guide for franchises
Business Banking A guide for franchises Hep with your franchise business, right on your doorstep A true understanding of the needs of your business: that s what makes RBS the right choice for financia
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l. l l. l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow, some of which may not appy your account Some of these
More informationDigitalKitbag. Email marketing
Emai marketing Who are Digita Kitbag? We re your business marketing team Digita Kitbag is owned and operated by Johnston Press, one of the argest regiona media pubishers in the UK and Ireand. We have a
More informationLADDER SAFETY Table of Contents
Tabe of Contents SECTION 1. TRAINING PROGRAM INTRODUCTION..................3 Training Objectives...........................................3 Rationae for Training.........................................3
More informationIntroduction the pressure for efficiency the Estates opportunity
Heathy Savings? A study of the proportion of NHS Trusts with an in-house Buidings Repair and Maintenance workforce, and a discussion of eary experiences of Suppies efficiency initiatives Management Summary
More informationAvaya Remote Feature Activation (RFA) User Guide
Avaya Remote Feature Activation (RFA) User Guide 03-300149 Issue 5.0 September 2007 2007 Avaya Inc. A Rights Reserved. Notice Whie reasonabe efforts were made to ensure that the information in this document
More informationNormalization of Database Tables. Functional Dependency. Examples of Functional Dependencies: So Now what is Normalization? Transitive Dependencies
ISM 602 Dr. Hamid Nemati Objectives The idea Dependencies Attributes and Design Understand concepts normaization (Higher-Leve Norma Forms) Learn how to normaize tabes Understand normaization and database
More informationCONTRIBUTION OF INTERNAL AUDITING IN THE VALUE OF A NURSING UNIT WITHIN THREE YEARS
Dehi Business Review X Vo. 4, No. 2, Juy - December 2003 CONTRIBUTION OF INTERNAL AUDITING IN THE VALUE OF A NURSING UNIT WITHIN THREE YEARS John N.. Var arvatsouakis atsouakis DURING the present time,
More informationThe BBC s management of its Digital Media Initiative
The BBC s management of its Digita Media Initiative Report by the Comptroer and Auditor Genera presented to the BBC Trust s Finance and Compiance Committee, 13 January 2011 Department for Cuture, Media
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow, some of which may not appy your account Some of these
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow, some of which may not appy your account Some of these
More informationPay-on-delivery investing
Pay-on-deivery investing EVOLVE INVESTment range 1 EVOLVE INVESTMENT RANGE EVOLVE INVESTMENT RANGE 2 Picture a word where you ony pay a company once they have deivered Imagine striking oi first, before
More informationThe guaranteed selection. For certainty in uncertain times
The guaranteed seection For certainty in uncertain times Making the right investment choice If you can t afford to take a ot of risk with your money it can be hard to find the right investment, especiay
More informationeg Enterprise vs. a Big 4 Monitoring Soution: Comparing Tota Cost of Ownership Restricted Rights Legend The information contained in this document is confidentia and subject to change without notice. No
More informationSoftware Quality - Getting Right Metrics, Getting Metrics Right
Software Quaity - Getting Right Metrics, Getting Metrics Right How to set the right performance metrics and then benchmark it for continuous improvement? Whie metrics are important means to quantify performance
More informationDesign Considerations
Chapter 2: Basic Virtua Private Network Depoyment Page 1 of 12 Chapter 2: Basic Virtua Private Network Depoyment Before discussing the features of Windows 2000 tunneing technoogy, it is important to estabish
More informationBest Practices for Push & Pull Using Oracle Inventory Stock Locators. Introduction to Master Data and Master Data Management (MDM): Part 1
SPECIAL CONFERENCE ISSUE THE OFFICIAL PUBLICATION OF THE Orace Appications USERS GROUP spring 2012 Introduction to Master Data and Master Data Management (MDM): Part 1 Utiizing Orace Upgrade Advisor for
More informationFixed income managers: evolution or revolution
Fixed income managers: evoution or revoution Traditiona approaches to managing fixed interest funds rey on benchmarks that may not represent optima risk and return outcomes. New techniques based on separate
More informationKey Features of Life Insurance
Key Features of Life Insurance Life Insurance Key Features The Financia Conduct Authority is a financia services reguator. It requires us, Aviva, to give you this important information to hep you to decide
More informationELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES. l l l
ELECTRONIC FUND TRANSFERS YOUR RIGHTS AND RESPONSIBILITIES The Eectronic Fund Transfers we are capabe of handing for consumers are indicated beow, some of which may not appy your account Some of these
More informationSABRe B2.1: Design & Development. Supplier Briefing Pack.
SABRe B2.1: Design & Deveopment. Suppier Briefing Pack. 2013 Ros-Royce pc The information in this document is the property of Ros-Royce pc and may not be copied or communicated to a third party, or used
More informationOlder people s assets: using housing equity to pay for health and aged care
Key words: aged care; retirement savings; reverse mortgage; financia innovation; financia panning Oder peope s assets: using housing equity to pay for heath and aged care The research agenda on the ageing
More informationWith the arrival of Java 2 Micro Edition (J2ME) and its industry
Knowedge-based Autonomous Agents for Pervasive Computing Using AgentLight Fernando L. Koch and John-Jues C. Meyer Utrecht University Project AgentLight is a mutiagent system-buiding framework targeting
More informationInformation Systems Technician Training Series
NONRESIDENT TRAINING COURSE Information Systems Technician Training Series Modue 1 Administration and Security NAVEDTRA 14222 IMPORTANT Any future change to this course can be found at https://www.advancement.cnet.navy.mi,
More informationBooks on Reference and the Problem of Library Science
Practicing Reference... Learning from Library Science * Mary Whisner ** Ms. Whisner describes the method and some of the resuts reported in a recenty pubished book about the reference interview written
More informationNCH Software BroadCam Video Streaming Server
NCH Software BroadCam Video Streaming Server This user guide has been created for use with BroadCam Video Streaming Server Version 2.xx NCH Software Technica Support If you have difficuties using BroadCam
More informationEstimation of Liabilities Due to Inactive Hazardous Waste Sites. by Raja Bhagavatula, Brian Brown, and Kevin Murphy
Estimation of Liabiities Due to Inactive Hazardous Waste Sites by Raja Bhagavatua, Brian Brown, and Kevin Murphy ESTIMATION OF LIABILITIES DUE TO INACTIVE HAZARDOUS WASTE SITJZS Abstract: The potentia
More informationMICROSOFT DYNAMICS CRM
biztech TM MICROSOFT DYNAMICS CRM Experienced professionas, proven toos and methodoogies, tempates, acceerators and vertica specific soutions maximizing the vaue of your Customer Reationships Competency
More informationINDUSTRIAL PROCESSING SITES COMPLIANCE WITH THE NEW REGULATORY REFORM (FIRE SAFETY) ORDER 2005
INDUSTRIAL PROCESSING SITES COMPLIANCE WITH THE NEW REGULATORY REFORM (FIRE SAFETY) ORDER 2005 Steven J Manchester BRE Fire and Security E-mai: manchesters@bre.co.uk The aim of this paper is to inform
More informationAdvantages and Disadvantages of Sampling. Vermont ASQ Meeting October 26, 2011
Advantages and Disadvantages of Samping Vermont ASQ Meeting October 26, 2011 Jeffrey S. Soomon Genera Dynamics Armament and Technica Products, Inc. Wiiston, VT 05495 Outine I. Definition and Exampes II.
More informationSecure Network Coding with a Cost Criterion
Secure Network Coding with a Cost Criterion Jianong Tan, Murie Médard Laboratory for Information and Decision Systems Massachusetts Institute of Technoogy Cambridge, MA 0239, USA E-mai: {jianong, medard}@mit.edu
More informationManagement Accounting
Management Accounting Course Text Professiona, Practica, Proven www.accountingtechniciansireand.ie Tabe of Contents FOREWORD...v SYLLABUS: MANAGEMENT ACCOUNTING...vii PART 1 INTRODUCTION Chapter 1: Introduction
More informationDECEMBER 2008. Good practice contract management framework
DECEMBER 2008 Good practice contract management framework The Nationa Audit Office scrutinises pubic spending on behaf of Pariament. The Comptroer and Auditor Genera, Tim Burr, is an Officer of the House
More informationBusiness schools are the academic setting where. The current crisis has highlighted the need to redefine the role of senior managers in organizations.
c r o s os r oi a d s REDISCOVERING THE ROLE OF BUSINESS SCHOOLS The current crisis has highighted the need to redefine the roe of senior managers in organizations. JORDI CANALS Professor and Dean, IESE
More informationASSET MANAGEMENT OUR APPROACH
ASSET MANAGEMENT OUR APPROACH CONTENTS FOREWORD 3 INTRODUCTION 4 ASSET MANAGEMENT? 6 THE NEED FOR CHANGE 6 KEY PRINCIPLES 7 APPENDIX 1 19 GLOSSARY 20 2 FOREWORD Few things affect our customers ives as
More informationChapter 3: JavaScript in Action Page 1 of 10. How to practice reading and writing JavaScript on a Web page
Chapter 3: JavaScript in Action Page 1 of 10 Chapter 3: JavaScript in Action In this chapter, you get your first opportunity to write JavaScript! This chapter introduces you to JavaScript propery. In addition,
More informationIntegrating Risk into your Plant Lifecycle A next generation software architecture for risk based
Integrating Risk into your Pant Lifecyce A next generation software architecture for risk based operations Dr Nic Cavanagh 1, Dr Jeremy Linn 2 and Coin Hickey 3 1 Head of Safeti Product Management, DNV
More informationTMI ING Guide to Financial Supply Chain Optimisation 29. Creating Opportunities for Competitive Advantage. Section Four: Supply Chain Finance
TMI171 ING info pat :Info pat.qxt 19/12/2008 17:02 Page 29 ING Guide to Financia Suppy Chain Optimisation Creating Opportunities for Competitive Advantage Section Four: Suppy Chain Finance Introduction
More informationTeach yourself Android application development - Part I: Creating Android products
Teach yoursef Android appication deveopment - Part I: Creating Android products Page 1 of 7 Part of the EE Times Network A Artices Products Course TechPaper Webinars Login Register Wecome, Guest HOME DESIGN
More informationStrengthening Human Resources Information Systems: Experiences from Bihar and Jharkhand, India
Strengthening Human Resources Information Systems: Experiences from Bihar and Jharkhand, India Technica Brief October 2012 Context India faces critica human resources (HR) chaenges in the heath sector,
More informationGREEN: An Active Queue Management Algorithm for a Self Managed Internet
: An Active Queue Management Agorithm for a Sef Managed Internet Bartek Wydrowski and Moshe Zukerman ARC Specia Research Centre for Utra-Broadband Information Networks, EEE Department, The University of
More informationGRADUATE RECORD EXAMINATIONS PROGRAM
VALIDITY and the GRADUATE RECORD EXAMINATIONS PROGRAM BY WARREN W. WILLINGHAM EDUCATIONAL TESTING SERVICE, PRINCETON, NEW JERSEY Vaidity and the Graduate Record Examinations Program Vaidity and the Graduate
More informationOracle. L. Ladoga Rybinsk Res. Volga. Finland. Volga. Dnieper. Dnestr. Danube. Lesbos. Auditing Oracle Applications Peloponnesus
N o r w e g i a n S e a White 60ûN ATLANTIC OCEAN UNITED KINGDOM Rio Douro Hebrid Bay of Biscay Garonne Faroe Isands Shetand Isands Orkney Isands North Loire ine Rhone Rhine Po Ebe Adriatic Batic Guf of
More informationI m pretty lucky as far as teen librarians
feature Hot Spot: Teen Tech Week Onine Marketing Strategies for Reaching Today s Teens By Laura Peowski Horn I m pretty ucky as far as teen ibrarians go. The ibrary I work at is right next to the ony high
More informationBudgeting Loans from the Social Fund
Budgeting Loans from the Socia Fund tes sheet Pease read these notes carefuy. They expain the circumstances when a budgeting oan can be paid. Budgeting Loans You may be abe to get a Budgeting Loan if:
More informationQualifications, professional development and probation
UCU Continuing Professiona Deveopment Quaifications, professiona deveopment and probation Initia training and further education teaching quaifications Since September 2007 a newy appointed FE ecturers,
More informationSubject: Corns of En gineers and Bureau of Reclamation: Information on Potential Budgetarv Reductions for Fiscal Year 1998
GAO United States Genera Accounting Office Washington, D.C. 20548 Resources, Community, and Economic Deveopment Division B-276660 Apri 25, 1997 The Honorabe Pete V. Domenici Chairman The Honorabe Harry
More informationLeadership & Management Certificate Programs
MANAGEMENT CONCEPTS Leadership & Management Certificate Programs Programs to deveop expertise in: Anaytics // Leadership // Professiona Skis // Supervision ENROLL TODAY! Contract oder Contract GS-02F-0010J
More informationDOING BUSINESS WITH THE REGION OF PEEL A GUIDE FOR NEW AND CURRENT VENDORS
DOING BUSINESS WITH THE REGION OF PEEL A GUIDE FOR NEW AND CURRENT VENDORS TABLE OF CONTENTS INTRODUCTION... 1 GOVERNANCE... 1 COMMONLY PURCHASED GOODS AND SERVICES... 1 HOW TO REGISTER YOUR COMPANY...
More informationWhat makes a good Chair? A good chair will also: l always aim to draw a balance between hearing everyone s views and getting through the business.
Chairing a meeting An important job of the Chairperson is chairing meetings. Prior House 6 Tibury Pace Brighton BN2 0GY Te. 01273 606160 Fax. 01273 673663 info@resourcecentre.org.uk www.resourcecentre.org.uk
More informationRicoh Healthcare. Process Optimized. Healthcare Simplified.
Ricoh Heathcare Process Optimized. Heathcare Simpified. Rather than a destination that concudes with the eimination of a paper, the Paperess Maturity Roadmap is a continuous journey to strategicay remove
More informationCERTIFICATE COURSE ON CLIMATE CHANGE AND SUSTAINABILITY. Course Offered By: Indian Environmental Society
CERTIFICATE COURSE ON CLIMATE CHANGE AND SUSTAINABILITY Course Offered By: Indian Environmenta Society INTRODUCTION The Indian Environmenta Society (IES) a dynamic and fexibe organization with a goba vision
More informationAPIS Software Training /Consulting
APIS Software Training /Consuting IQ-Software Services APIS Informationstechnoogien GmbH The information contained in this document is subject to change without prior notice. It does not represent any
More informationSplitting the Organization and Integrating the Code: Conway s Law Revisited
Spitting the Organization and Integrating the Code: Conway s Law Revisited James D. Herbseb and Rebecca E. Grinter Be Laboratories, Lucent Technoogies 263 Shuman Bvd Napervie, Iinois 60566. USA + 630.713.1869
More informationNCH Software MoneyLine
NCH Software MoneyLine This user guide has been created for use with MoneyLine Version 2.xx NCH Software Technica Support If you have difficuties using MoneyLine pease read the appicabe topic before requesting
More informationIncome Protection Options
Income Protection Options Poicy Conditions Introduction These poicy conditions are written confirmation of your contract with Aviva Life & Pensions UK Limited. It is important that you read them carefuy
More informationInternal Control. Guidance for Directors on the Combined Code
Interna Contro Guidance for Directors on the Combined Code ISBN 1 84152 010 1 Pubished by The Institute of Chartered Accountants in Engand & Waes Chartered Accountants Ha PO Box 433 Moorgate Pace London
More informationSetting Up Your Internet Connection
4 CONNECTING TO CHANCES ARE, you aready have Internet access and are using the Web or sending emai. If you downoaded your instaation fies or instaed esigna from the web, you can be sure that you re set
More informationNetwork/Communicational Vulnerability
Automated teer machines (ATMs) are a part of most of our ives. The major appea of these machines is convenience The ATM environment is changing and that change has serious ramifications for the security
More informationLaw Libraries in the Cloud **
LAW LIBRARY JOURNAL Vo. 101:2 [2009-15] Technoogy for Everyone... * Law Libraries in the Coud ** Diane Murey *** Ms. Murey provides an overview of the meanings of coud computing and software as a service,
More informationFast Robust Hashing. ) [7] will be re-mapped (and therefore discarded), due to the load-balancing property of hashing.
Fast Robust Hashing Manue Urueña, David Larrabeiti and Pabo Serrano Universidad Caros III de Madrid E-89 Leganés (Madrid), Spain Emai: {muruenya,darra,pabo}@it.uc3m.es Abstract As statefu fow-aware services
More informationINTERNATIONAL PAYMENT INSTRUMENTS
INTERNATIONAL PAYMENT INSTRUMENTS Dr Nguyen Minh Duc 2009 1 THE INTERNATIONAL CHAMBER OF COMMERCE THE ICC AT A GLANCE represent the word business community at nationa and internationa eves promotes word
More informationSPOTLIGHT. A year of transformation
WINTER ISSUE 2014 2015 SPOTLIGHT Wecome to the winter issue of Oasis Spotight. These newsetters are designed to keep you upto-date with news about the Oasis community. This quartery issue features an artice
More informationMARKETING INFORMATION SYSTEM (MIS)
LESSON 4 MARKETING INFORMATION SYSTEM (MIS) CONTENTS 4.0 Aims and Objectives 4.1 Introduction 4.2 MIS 4.2.1 Database 4.2.2 Interna Records 4.2.3 Externa Sources 4.3 Computer Networks and Internet 4.4 Data
More informationHow to deal with personal financial problems
How to dea with persona financia probems D I S P U T E R E S O L U T I O N Introduction Heping you face the future with confidence In 2014, the eve of consumer debt in the UK grew to reach a seven-year
More informationFINANCIAL ACCOUNTING
FINANCIAL ACCOUNTING Part 1 A conceptua framework: setting the scene 1 Who needs accounting? 2 A systematic approach to financia reporting: the accounting equation 3 Financia statements from the accounting
More information(12) Patent Application Publication (10) Pub. N0.: US 2006/0105797 A1 Marsan et al. (43) Pub. Date: May 18, 2006
(19) United States US 20060105797A (12) Patent Appication Pubication (10) Pub. N0.: US 2006/0105797 A1 Marsan et a. (43) Pub. Date: (54) METHOD AND APPARATUS FOR (52) US. C...... 455/522 ADJUSTING A MOBILE
More informationCI/SfB Ro8. (Aq) September 2012. The new advanced toughened glass. Pilkington Pyroclear Fire-resistant Glass
CI/SfB Ro8 (Aq) September 2012 The new advanced toughened gass Pikington Pyrocear Fire-resistant Gass Pikington Pyrocear, fire-resistant screens in the façade: a typica containment appication for integrity
More informationAA Fixed Rate ISA Savings
AA Fixed Rate ISA Savings For the road ahead The Financia Services Authority is the independent financia services reguator. It requires us to give you this important information to hep you to decide whether
More information