HP Universal CMDB. Software Version: Sizing Guide

Transcription

1 HP Universal CMDB Sftware Versin: Sizing Guide Dcument Release Date: December 2015 Sftware Release Date: December 2015

2 Legal Ntices Warranty The nly warranties fr HP prducts and services are set frth in the express warranty statements accmpanying such prducts and services. Nthing herein shuld be cnstrued as cnstituting an additinal warranty. HP shall nt be liable fr technical r editrial errrs r missins cntained herein. The infrmatin cntained herein is subject t change withut ntice. Restricted Rights Legend Cnfidential cmputer sftware. Valid license frm HP required fr pssessin, use r cpying. Cnsistent with FAR and , Cmmercial Cmputer Sftware, Cmputer Sftware Dcumentatin, and Technical Data fr Cmmercial Items are licensed t the U.S. Gvernment under vendr's standard cmmercial license. Cpyright Ntice Hewlett-Packard Develpment Cmpany, L.P. Trademark Ntices Adbe is a trademark f Adbe Systems Incrprated. Micrsft and Windws are U.S. registered trademarks f Micrsft Crpratin. UNIX is a registered trademark f The Open Grup. Dcumentatin Updates The title page f this dcument cntains the fllwing identifying infrmatin: Sftware Versin number, which indicates the sftware versin. Dcument Release Date, which changes each time the dcument is updated. Sftware Release Date, which indicates the release date f this versin f the sftware. T check fr recent updates r t verify that yu are using the mst recent editin f a dcument, g t: This site requires that yu register fr an HP Passprt and t sign in. T register fr an HP Passprt ID, click Register n the HP Supprt site r click Create an Accunt n the HP Passprt lgin page. Yu will als receive updated r new editins if yu subscribe t the apprpriate prduct supprt service. Cntact yur HP sales representative fr details. Supprt Visit the HP Sftware Supprt site at: This website prvides cntact infrmatin and details abut the prducts, services, and supprt that HP Sftware ffers. HP Sftware nline supprt prvides custmer self-slve capabilities. It prvides a fast and efficient way t access interactive technical supprt tls needed t manage yur business. As a valued supprt custmer, yu can benefit by using the supprt website t: Search fr knwledge dcuments f interest Submit and track supprt cases and enhancement requests Dwnlad sftware patches Manage supprt cntracts Lk up HP supprt cntacts Review infrmatin abut available services Enter int discussins with ther sftware custmers Research and register fr sftware training Mst f the supprt areas require that yu register as an HP Passprt user and t sign in. Many als require a supprt cntract. T register fr an HP Passprt ID, click Register n the HP Supprt site r click Create an Accunt n the HP Passprt lgin page. T find mre infrmatin abut access levels, g t: HP Sftware Slutins Nw accesses the HPSW Slutin and Integratin Prtal website. This site enables yu t explre HP Prduct Slutins t meet yur business needs, includes a full list f Integratins between HP Prducts, as well as a listing f ITIL Prcesses. The URL fr this website is HP Universal CMDB (10.22) Page 2 f 21

3 Cntents 4 Right Sizing - high perfrmance HP Cnfiguratin Management System 5 Infrastructure Requirements 7 Planning Yur Discvery Schedule 8 Sizing XML Enricher 10 Metrics f Interest 12 Enterprise Grade Cnfiguratin 18 Enterprise Grade Deplyment 20 Other Recmmendatins 20 Send Dcumentatin Feedback 21 HP Universal CMDB (10.22) Page 3 f 21

4 The purpse f this dcument is t help HP Universal CMDB (UCMDB) and HP Universal Discvery (UD) custmers t right size yur CMS infrastructure t supprt yur CMDB strategy. The bjective f sizing is t estimate the system resurce required t ensure the deplyed system meets the perfrmance bjectives. This dcument includes: Right Sizing - high perfrmance HP Cnfiguratin Management System 5 Infrastructure Requirements 7 Planning Yur Discvery Schedule 8 Sizing XML Enricher 10 Metrics f Interest 12 Enterprise Grade Cnfiguratin 18 Enterprise Grade Deplyment 20 Other Recmmendatins 20 HP Universal CMDB (10.22) Page 4 f 21

5 Right Sizing - high perfrmance HP Cnfiguratin Management System This sectin helps yu t right size the UCMDB/UD architecture t scale the discvery needs fr yur enterprise. Right sizing enables enterprises t deliver value ut f CMS design. UCMDB/UD applicatin perfrmance depends n many factrs. Amunt f data (discverable and nndiscverable) that will be stred in UCMDB/UD is just ne aspect. HP Universal CMDB (10.22) Page 5 f 21

6 HP Universal CMDB (10.22) Page 6 f 21

7 Infrastructure Requirements The perfrmance f UCMDB Server, Data Flw Prbe server, and UCMDB database server is critical fr running CMS peratins successfully. UCMDB Server Deplyment CPU RAM Disk Space Small 4 cres 16 GB 60 GB Standard 8 cres 32 GB 80 GB Enterprise 24 cres 64 GB 100 GB Data Flw Prbe Server Deplyment CPU RAM Disk Space Small 4 cres 12 GB 100 GB Standard 8 cres 16 GB 200 GB Enterprise 16 cres 24 GB 300 GB Right Sizing CMS Database Chsing the right database based n the enterprise requirement will help yu understand the max limits we have n the ttal number CIs yu can discver with respect t different RDBMS ptins we have. Check the HP Universal CMDB Database Guide t right size yur CMS database. Database Database Oracle Micrsft SQL SERVER 2012 Micrsft SQL SERVER - previus versins PstgreSQL MAXIMUM # CIS & RELATIONSHIPS 60 Millin CIs and Relatinships 60 Millin CIs and Relatinships 40 Millin CIs and Relatinships 12.5 Millin CIs and Relatinships Fr an enterprise grade custmer, HP recmmends t use physical database servers with 24 Cres and 64GB RAM. HP Universal CMDB (10.22) Page 7 f 21

8 Planning Yur Discvery Schedule G t Discvery Use Cases and identify the list f discvery jbs yu want t run t meet yur peratinal needs. Let us assume tw basic use cases: Agentless discvery Agent-based discvery (tw ptins, with r withut call hme setting) Agent-based discvery Agentless Basic Discvery Optin 1: Fr client devices with call hme setting Optin 2: Fr datacenter devices withut call hme setting ICMP Ping Call hme prcessing ICMP Ping Hst Cnnectin by Shell Hst Resurces by Shell Hst Applicatins by Shell Inventry discvery by scanner Hst Cnnectin by Shell Inventry discvery by scanner When yu think abut these basic use cases, a cuple f questins will arise: Hw many prbes are required t cmplete yur discvery? Hw frequently can yu run these jbs? What is the valid business use case n the rediscvery interval? Is there an upper limit n the number f trigger CIs a prbe can handle? Planning yur discvery capacity based n yur use cases will give yu gd handle n the number f related CIs per discvered nde. When planning capacity, amng ther issues, yu shuld cnsider the rati f managed ndes in yur CMDB t nde-related CIs. Nde-related CIs include all CIs f types that are subclasses f Applicatin Resurce, Nde Element, r Running Sftware. The fllwing diagram gives yu an idea n the number f nde-related CIs yu can discver fr each managed nde based n the size and use cases. This number depends n the size f yur deplyment HP Universal CMDB (10.22) Page 8 f 21

9 and the number f managed ndes the mre managed ndes yu maintain in the CMDB, the fewer nde-related CIs yu can discver fr each managed nde. Managed Ndes t Nde-Related CIs Rati Fr example, in an enterprise deplyment, if yu are running 134,400 managed ndes, yu can discver 160 nde-related CIs fr each managed nde. If yu are running nly 43,200 managed ndes, yu can discver 500 resurce CIs fr each managed nde. This rati will give yu an idea n the scalability and deplyment strategy. HP Universal CMDB (10.22) Page 9 f 21

10 Sizing XML Enricher The XML Enricher is used in UD Inventry scan jbs t prcess scan files. If yur CMS envirnment leverages UD Inventry jbs, then yu need t plan fr extra memry requirement n the prbes fr the XML Enricher. Starting frm Universal Discvery versin 10.10, the XML Enricher is re-written in Java and uses 64-bit JRE. The table belw summarizes the memry and thread settings required t run XML Enricher prcess: Prbe Deplyment Mde XML Enricher Thread Cunt XML Enricher JVM Memry (MB) XML Enricher Mde Small Database Standard Memry Enterprise Memry Small deplyment f the prbe. In this mde the XML Enricher is cnfigured t use the DB mde t save memry. DB mde fr the XML Enricher is an ptin which can be leveraged fr small size deplyment where it stres the largest prtin f the SAI files and the file data in the temprary database instead f keeping it in memry. It saves quite a bit f memry, but the prcessing speed fr incming scan files is degraded and disk I/O n the server running the prbe will shw sme spikes. Standard deplyment f the prbe. The number f XML Enricher threads plays a vital rle in the prbe sizing fr the Standard prbe deplyment. Enterprise deplyment f the prbe. The Enterprise mde uses mre threads and mre memry fr prcessing, but has the best perfrmance (prvided that the prbe s hardware is sized apprpriately). If ne needs t scale even mre (if there is a build-up f scan files in the Incming directry f the XML Enricher), ne can increase the amunt f threads further. HP CMS prduct R&D team has tested up t 8 XML Enricher threads wrking in parallel. But in this case large amunts f memry (up t 16 GB) needs t be allcated fr its JVM, s it des nt run ut f the prbe memry when prcessing very large scan files. Nte: The XML Enricher runs as a separate prcess frm the prbe and has its wn JVM. Even if the XML Enricher runs ut f memry, it des nt affect the prbe prcess that runs separately. Increasing the XML Enricher thread cunt helps t imprve scan prcessing perfrmance. HP Universal CMDB (10.22) Page 10 f 21

11 Higher numbers f threads that are allcated t the XML Enricher service results in higher amunts f CPU and memry that the XML Enricher prcess cnsumes. As a result, the prcessing f scan files runs faster and faster. Hwever, t many threads may slw dwn the prcessing if there is nt enugh CPU r memry resurces available. In this case, disk perfrmance becmes a cnstraining factr. HP Universal CMDB (10.22) Page 11 f 21

12 Metrics f Interest UCMDB/UD can be deplyed in many ways and yu can cnfigure discvery in varius ways. Fr example, yu have the ptin t chse Zne-Based Discvery t run inventry scans and Discvery Mdules/Jbs t cnfigure ther discvery jbs. The metrics belw prvides a guidance n the sizing f a prbe server that the CMS prduct team has fully tested in custmer envirnments. The fllwing tw typical scenaris have been tested fr yur reference. Scenari 20,000 Scans per week 75,000 scans per tw weeks Descriptin This scenari is based-n sme impact factrs. Fr example, average number f CIs per scan, DB size, netwrk latency, device nline timeslt, and s n. Fr mre details, see 20,000 Scans per week. This scenari is based-n the cllabratin f Scanner Scheduler, Stre and Frward and XML Enricher at enterprise grade cnfiguratin. Fr mre details, see 75,000 scans per tw weeks. 20,000 scans per week An enterprise grade prbe server is capable f handling at least 20,000 scans per week n the cnditin that the average number f related CIs fr each scan is 250. This means that the ttal cunt f related CIs n the prbe DB (ddm_discvery_results) will reach 5 millin CIs. When the ttal cunt f related CIs n the prbe DB cntinues t grw while mre scans are executed, a prbe server perfrmance decrease is bserved. This depends n the diversity f the data in the DB. As shwn in the fllwing diagram, there is a capacity threshld n the prbe DB, beynd which the capacity decreases a lt. HP Universal CMDB (10.22) Page 12 f 21

13 The numbers belw are benchmark results frm lab tests. Test results are based n enterprise grade UCMDB and Data Flw Prbe servers. Time in secnds shws the amunt f time it tk t run the discvery jbs in the HP Lab envirnment per discvery trigger (that is, per nde r IP). Discvery Jb Lw Netwrk Latency (sec) High Netwrk Latency (sec) Hst Cnnectin by Shell Hst Resurces IOPS Numbers frm sampling analysis fr Inventry scan n virtual envirnment client devices The VMware vrealize tl was used t measure IOPS peak usage. 2 t 3 scan files are received per min t the incming flder. Number f XML Enricher is set t 2 threads. Scanner Cnfiguratins # Threads Peak IOPS Key hardware data and n file data Key Hardware and File Data (Key installatin Directries) Key Hardware and all file data HP Universal CMDB (10.22) Page 13 f 21

14 Test Bed UCMDB/UD deplyment and cnfiguratin Enterprise Grade Deplyment Enterprise Grade Cnfiguratin Nte: VMware virtualizatin were used t spin up prbes machines and dedicated VCPUs were assigned. High end perfrmance strage Inventry scans were tested with NTCMD/SSH/UDA prtcls. Impact factrs n the discvery capacity per prbe per week The data in the table belw are cllected during the testing fr the prbe capacity f 20,000/250 scan per week. Impact Factrs shw what will impact the prbe capacity. Impact Level indicates hw seriusly the capacity will be impacted. Mre stars means higher level f impact. Stars are the weight f each factr. The Value clumn shws the value used fr the impact factr during ur testing. Impact Factrs Impact level (Lw 1-5 High) Value used in testing Cmments Average number f related CIs per scan Frequency f reassign IP fr client device by 250 The type f perating system has impact n the number f installed sftware CIs. Fr example, enabling BaseUnixOs.sai fr the XML Enricher t prcess Unix scan files will intrduce a lt f installed sftware. 15,000 client devices: every 7 Days HP Universal CMDB (10.22) Page 14 f 21

15 Impact Factrs Impact level (Lw 1-5 High) Value used in testing Cmments DHCP The number f management znes used Cnnect failure rati 0 Refer t the management zne cnfiguratin. The cnnectin may fail due t netwrk issue r during mving. This depends n yur envirnment. Netwrk latency between prbe & discvery devices Number f IPs Devices nline timeslts Change Rati fr the discvered CIs Discvery jbs In the same LAN: ~320 ms 0.5 millin Data Center: 24 hurs/day Client: 8 hurs/day Less than 11% Fr fixed IPs: Usually this is the ping time frm prbe t discvery ndes. The higher change rati f discvered CIs, the lnger time it takes t push the changed CIs t the UCMDB server. Range IPs by ICMP Hst Cnnecti n by Shell Inventry Discvery by Scanner HP Universal CMDB (10.22) Page 15 f 21

16 Impact Factrs Impact level (Lw 1-5 High) Value used in testing Cmments Fr Dynamic IPs: Call hme prcessing Inventry Discvery by Scanner # Max wrker number per prbe # Threads f Inventry Discvery by Scanner Schedule f Inventry Discvery by Scanner Number f ttal CIs in UCMDB Weekly: 24x7, n blackut plicy Data Center: 18 millin (CIs & relatinships) Pay attentin t installed sftware CI. Usually it plays a great prtin. Client: 25.2 millin (CIs & relatinships) The size f prbe DB tables ddm_ discvery_ results: 3.5 millin HP Universal CMDB (10.22) Page 16 f 21

17 Impact Factrs Impact level (Lw 1-5 High) Value used in testing Cmments ddm_map_ bjectid: 3 millin 75,000 scans per tw weeks An enterprise grade prbe can supprt up t 75,000 scans per tw weeks. T achieve this, the cmbinatin f the fllwing cnfiguratins shuld be perfrmed. Scanner Scheduler Stre and Frward scenaris: One enterprise prbe server and tw stre and frward servers ( specificatins with enterprise prbe grade server with n ther applicatins running) XML Enricher is at enterprise grade cnfiguratin Only Inventry discvery by Manual Scanner Deplyment running n the prbe Test Bed UCMDB/UD deplyment and cnfiguratin Enterprise Grade Deplyment XML Enricher Enterprise Mde HP Universal CMDB (10.22) Page 17 f 21

18 Enterprise Grade Cnfiguratin Belw cnfiguratins will help enterprise custmers t scale inventry and agentless discvery jbs. Prbe memry settings and thread cnfiguratins can be adjusted based n the discvery needs. The fllwing cnfiguratins are based n Unin mde prbes. The settings might change fr Separate mde prbes. Prperty files n the prbe Setting Details Cmments hp\ucmdb\dataflwprbe\bin\ xmlenricher\ WrapperEnricher.cnf hp\ucmdb\dataflwprbe\bin\ WrapperGateway.cnf wrapper.java.maxmemry=8192 Mdify the fllwing lines: JRE 7 and lder: wrapper.java.additinal.19=- XX:PermSize=512m wrapper.java.additinal.20=- XX:MaxPermSize=768m JRE 8 and later: Fr large prbes: Change the XML Enricher cnfiguratin t use "Enterprise" deplyment Increase ther heap settings, s that there is enugh special memry available fr JVM. These ptins are needed fr JRE 7 nly. hp\ucmdb\dataflwprbe\cnf\ enricher.prperties hp\ucmdb\dataflwprbe\bin\ WrapperEnv.cnf hp\ucmdb\dataflwprbe\cnf\ pstgresql.cnf wrapper.java.additinal.21=- XX:MaxMetaspaceSize=768 m max_enricher_thread_ number=4 set.gateway_min_mem=2048 set.gateway_max_mem=8192 set.manager_min_mem=2048 set.manager_max_mem=8192 shared_buffers = 1024MB Fr large prbes: Change the XML Enricher cnfiguratin t use "Enterprise" deplyment Increase the amunt f memry used by JVM, s that it can run mre discvery jbs in parallel Increase the amunt f memry that PstgreSQL can use fr buffering the data in HP Universal CMDB (10.22) Page 18 f 21

19 , cntinued Prperty files n the prbe Setting Details Cmments memry hp\ucmdb\dataflwprbe\cnf\ DataFlwPrbe.prperties appilg.agent.lcal.services. plthreads=200 appilg.agent.lcal.services. defaultmaxjbthreads=40 appilg.agent.prbe.max Cnnectin=120 Increase the number f threads t be used by the prbe. This increases the cncurrency f peratins and allws mre discvery jbs t run simultaneusly. UCMDB/UD UI Changes (in the admin UI Infrastructure Settings) Glbal Setting Name Default Value Value fr a large deplyment Max number f Objects in Server 20,000,000 30,000,000 Max Number f Objects in the Custmer Mdel 20,000,000 30,000,000 TQL Grup Cllectrs Result Size 200, ,000 JMX Settings Glbal Setting Name Default Value Value fr a large deplyment tql.max.bjects.visit.mdel.calc.task 30,000,000 70,000,000 tql.grup.cllectrs.result.size 200, ,000 tql.instances.max.allwed 600,000 recnciliatin.cnnected.cis.fuse 40,000 HP Universal CMDB (10.22) Page 19 f 21

20 Enterprise Grade Deplyment Rle Deplyment CPU Memry (GB) Linux Swap (GB) Windws Virtual Memry (GB) Free Disk Space (GB) OS / 3rd-Party SW UCMDB Enterprise 24 cres Data Flw Prbe Intel Dual Cre XEON Prcessr 2.4 GHZ r later Windws 2008 R2 64- bit Red Hat Enterprise LINUX Server Release 6 AMD OPTERON Enterprise Dual Cre Prcessr 2.4 GHZ r later 24 n/a Windws 2008 R2 64- bit Database Enterprise Oracle Micrsft SQL Other Recmmendatins Virtual Machine Wrklad Management Effective virtual machine wrklad management practices, such as setting metrics, can help yu achieve the mst efficient wrklads and avid the mistake f ver-allcating resurces t a virtul machine. HP Universal CMDB (10.22) Page 20 f 21

21 Send Dcumentatin Feedback If yu have cmments abut this dcument, yu can cntact the dcumentatin team by . If an client is cnfigured n this system, click the link abve and an windw pens with the fllwing infrmatin in the subject line: Feedback n Sizing Guide (Universal CMDB 10.22) Just add yur feedback t the and click send. If n client is available, cpy the infrmatin abve t a new message in a web mail client, and send yur feedback t cms-dc@hp.cm. We appreciate yur feedback! HP Universal CMDB (10.22) Page 21 f 21