GENETIC NEURAL NETWORK BASED DATA MINING AND APPLICATION IN CASE ANALYSIS OF POLICE OFFICE

Transcription

1 GENETIC NEURAL NETWORK BASED DATA MINING AND APPLICATION IN CASE ANALYSIS OF POLICE OFFICE LIU Han-l, LI Ln, ZHU Ha-hong of Reource and Envronmen Scence, Wuhan Unvery, 9 Luoyu Road, Wuhan, P.R.Chna, Tel: E-mal: luhl000@ohu.com; lln@elecaro.com Keyword: Daa Mnng, Daa Warehoue, BP Neural Newor, Genec Algorm, Daa Cleanng, Cae Analy ABSTRACT: Th paper pu forward a meod a combne e learnng algorm of BP neural newor w genec algorm o ran BP newor and opmze e wegh value of e newor n a global cale. Th meod feaured a global opmzaon, hgh accuracy and fa convergence. The daa-mnng model baed on genec neural newor ha been wdely appled o e procedure of daa mnng on cae nformaon n e command cenre of polce offce. I acheve an excellen effec for ang people o olve cae and mae good decon. In paper, e prncple and meod of daa-mnng model are decrbed n deal. A real cae of applcaon alo preened. From cae we can draw a concluon a e daa-mnng model we have choen cenfc, effcen and praccable.. INTRODUCTION. The Defnon of Daa Mnng Daa mnng a procedure of exracon of nformaon and nowledge a are hded n daa, unnown by people and poenally ueful from a large quany of daa w mulple characerc a uncompleed, conanng noe, fuzzy and random. A a nd of cro-dcplne feld a yncreze mulple dcplne ncludng daabae echnology, arfcal nellgence, neural newor, ac, nowledge acquremen and nformaon exracon, nowaday daa mnng ha become one of e mo fron reearch drecon n e nernaonal realm of nformaon-baed decon mang. Analyng and comprehendng daa from dfferen apec, people ue daa mnng meod o dg ou ueful nowledge and hdden nformaon of predcon from a large amoun of daa a are ored n daabae and daa warehoue. The meod nclude aocaon rule, clafcaon nowledge, cluerng analy, endency and devaon analy a well a mlary analy. By fndng valuable nformaon from e analy reul, people can ue e nformaon o gude er bune acon and admnraon acon, or a er cenfc reearche. All of ee provde new opporune and challenge o e developmen of all nd of feld relaed o daa proceng.. The Applcaon of Daa Mnng Appled o e procedure of daa analyng, proceng and ulzaon a well a e procedure of decon mang n many ocal deparmen, daa warehoue and daa mnng echnologe a ee deparmen o mae cenfc and reaonable decon. Th ha profound meanng for e developmen of our ocey and economy. Daa mnng can be appled o varou dfferen realm. For nance, many ale deparmen ue daa mnng echnology o deermne e drbuon and e geographcal poon of e ale newor, e purchae and oc quane of every nd of good, n order o fnd ou e poenal cuomer group and adju e raege for ale. In nurance compane, oc compane, ban and cred card compane, people apply daa mnng echnology o deec e decepve acon of cuomer o reduce e commercal decepon. Daa mnng ha been alo wdely appled o medcal reamen and genec engneerng and many oer feld. In recen year, w e acceleraon of e ep of nformaon conrucon n polce deparmen and w e ncremen of developmen level, daa mnng echnology ha alo been appled o e polce deparmen epecally e command cenre of polce offce. Th paper manly dcue e prncple and e praccal applcaon of genec neural newor baed daa mnng model n cae analy of polce offce.. THE MEANING AND METHOD OF DATA MINING IN COMMAND CENTRE OF POLICE OFFICE. The Meanng of Daa Mnng n Command Cenre of Polce Offce Every day n e command cenre of polce offce, people receve a large number of nformaon abou cae receved w varou approache. The nformaon ha been npu no daabae o form a large amoun of cae nformaon. Thee cae nformaon ha been archved annually and perodcally o form a pleny of horcal cae reource. By nducng and analyng ee horcal cae, people can ge ome experence and learn ome leon a can help em olve cae and mae decon n e fuure. Therefore, n order o a polce deparmen o olve cae rapdly and mae decon effcenly, we hould yneze and organze ee horcal daa, ue proper daa mnng model o dcover e poenal and ueful nowledge behnd e daa, and en predc and analye e mporan facor n e daa ncludng e rae of crme, e conuon of crme populaon, e crme age rucure, e area drbuon of crme, e developng endency of crme, e mean and approache of crme, e hdden area of crmnal and o on. A preen all of ee have become urgen a a need our polce offce o accomplh n e procedure of daa proceng.. Two Sep of Daa Mnng The daa mnng procedure n e command cenre of polce offce manly nclude wo ep:

2 () Fr, flerng, elecng, cleanng and ynezng e archved horcal cae nformaon, and en performng ranformaon f neceary, fnally, loadng daa no daa warehoue afer above proceng. () Choong approprae model and algorm of daa mnng o dg ou e poenal nowledge n daa. By pleny of analy and comparon among varou daa mnng model, we elec e error bac propagaon (BP) neural newor a e general-purpoe calculaon model n our daa mnng. We ran e neural newor w a uperved learnng meod and combne BP algorm w genec algorm o opmze e value of wegh. Furer, we apply e raned model o e predcon, clafcaon and rule exracon of e cae nformaon. 3. DATA MINING MODEL OF NEURAL NETWORK 3. Common Meod of Daa Mnng Preen daa mnng meod nclude ac meod, aocaon dcovery, cluerng analy, clafcaon and regreon, OLAP(On Lne Analycal Proceng), query ool, EIS(Execuve Informaon Syem), neural newor, genec algorm and o on. Becaue of hgh durably agan noe daa, good ably of generalzaon, hgh accuracy and low error rae, neural newor model poee grea advanage among daa mnng meod. w become a popular ool n daa mnng. 3. Daa Mnng Model of BP Neural Newor BP neural newor a nd of feedforward newor a now n mo common ue. Generally ha a mul-layer rucure a con of a lea ree layer ncludng one npu layer, one oupu layer and one or more hdden layer. There are full connecon beween neuron n adjacen layer and no connecon beween neuron n e ame layer. Baed on a e of ranng ample and a e of eng daa, BP neural newor ran neuron and complee e procedure of learnng. The applcaon of BP algorm uable for daa mnng envronmen n whch mpoble o olve problem ung ordnary meod. Therefore we need ue complex funcon of everal varable o complee non-lnear calculaon o accomplh e em-rucural and non-rucural deconmang upporng procedure. So n e procedure of daa mnng n e command cenre of polce offce, we chooe e BP neural newor model. The bac rucure of BP neural newor a follow: x y The learnng procedure of neural newor can be dvded no ree phae: () The fr one a forward propagaon phae n whch a pecfed npu paern ha been pa rough e newor from npu layer rough hdden layer o e oupu layer and become an oupu paern. () The econd one an error bac propagaon phae. In phae, BP algorm compare e real oupu and e expeced oupu o calculae e error value. Afer a, propagae e error value from oupu layer rough hdden layer o npu layer n e oppoe drecon. The connecon wegh wll be alered durng phae. Thee wo phae proceed repeaedly and alernaely o complee e memory ranng of newor unl end o convergence and e global error end o mnmum. 3.3 Learnng Algorm of Neural Newor In praccal applcaon of daa mnng, we ue e ree-layer BP neural newor model a nclude a ngle hdden layer and elec dfferenable Sgmod funcon a acvaon funcon. The funcon defned a formula (): f x) = + ( () e x The learnng algorm of BP neural newor decrbed a follow: W (0) () Seng e nal wegh value : Generally we generae random nonzero floang number n nal wegh value. [ 0,] a e () Choong ceran number of par of npu and oupu ample and calculae e oupu of newor. The npu ample are x = ( x, x, L, xn ). The oupu ample are = (,, L, m ), =,, L, L. L e number of npu ample. When e npu ample e ample e oupu of e neuron : x j y ) = f ( w ( ) x ) j j ( () Where e npu of neuron when e npu ample e j ample. j y x x n y m (3) Calculang e global error of newor. When e npu ample e ample e error of newor. The calculang formula of E E : Fg. The Srucure of BP Neural Newor

3 E ( ) = ( y ( )) = e ( ) Where repreen e neuron of oupu layer. (3) y () e oupu of newor when npu ample e ample and e wegh value ha been adjued me. Afer ranng newor me baed on all of e L group of ample, e global error of all of ee ample : G ( ) = E ( ) (4) Deermnng f e algorm end. (4) G () ε (5) When e condon of formula (5) afed e algorm end. ε e lm value of error a pecfed beforehand. ε > 0. (5) Calculang e error of bac propagaon and adjung e wegh. The graden decen algorm ha been ued o calculae e adjumen value of wegh. The calculang formula a follow: G( ) wj ( + ) = wj ( ) η wj ( ) E ( ) = wj ( ) η (6) w ( ) Where η learnng rae of newor and alo e ep of wegh adjumen. 3.4 The Problem of BP Newor and The Soluon Becaue we ue e graden decen algorm o calculae e value of wegh, BP neural newor ll encouner problem uch a local mnmum, low convergence peed and convergence nably n ranng procedure. We combne wo meod o olve ee problem. One oluon o mprove e BP newor algorm. By addng eep facor or acceleraon facor n acvaon funcon, e peed of convergence can be acceleraed. In addon, by compreng e wegh value when ey are oo large, e newor paraly can be avoded. The mproved acvaon funcon defned w formula (7): f x = a, b, λ ) + a ( x b + e ) λ j ( (7) a Where a devaon parameer, b a poon parameer and λ e eep facor. Anoer oluon a: Genec algorm a concurrence global earch algorm. Becaue of excellen performance n global opmzaon, o we can combne e genec algorm w BP newor o opmze e connecon wegh of BP newor. And fnally we can ue e BP algorm for accurae predcon or clafcaon. 4. UTILIZING GENETIC ALGORITHM TO OPTIMIZE BP NEURAL NETWORK 4. The Prncple of Genec Algorm Genec algorm a nd of earch and opmzaon model bul by mulang e lengy evoluon perod of heredy elecon and naural elmnaon of bologcal colony. I an algorm of global probably earch. I doen depend on graden daa and needn e dfferenably of e funcon a wll be olved and only need e funcon can be olved under e condon of conran. Genec algorm ha powerful ably of macro cope earch and uable for global opmzaon. So by ung genec algorm o opmze e wegh of BP neural newor we can elmnae e problem of BP newor and enhance e generalzaon performance of e newor. The ndvdual n genec pace are chromoome. The bac conuon facor are gene. The poon of gene n ndvdual called locu. A e of ndvdual conruc a populaon. The fne repreen e evaluaon of adapably of ndvdual o envronmen. The elemenary operaon of genec algorm con of ree operand: elecon, croover and muaon. Selec alo called copy or reproducon. By calculang e fne f of ndvdual, we elec hgh qualy ndvdual w hgh fne, copy em o e new populaon and elmnae e ndvdual w low fne o generae e new populaon. Generally ued raege of elecon nclude roulee wheel elecon, expecaon value elecon, pared compeon elecon and reanng hgh qualy ndvdual elecon. Croover pu ndvdual n populaon afer elecon no mach pool and randomly mae ndvdual n par o form paren generaon. Then accordng o croover probably and e pecfed meod of croover, exchange par of e gene of ndvdual a n par o form new par of chld generaon and fnally o generae new ndvdual. Generally ued meod of croover are one pon croover, mul pon croover and average croover. Accordng o pecfed muaon rae, muaon ubue gene w er oppoe gene n ome loc o generae new ndvdual. 4. The Calculang Sep of Genec Algorm The meod and ep of ulzng genec algorm o opmze e wegh of BP newor are decrbed a follow: () Fr, group of wegh are gven a random and agned o e of BP newor. By ranng e newor, group of new wegh ha been calculaed and adjued. They conue e orgnal oluon pace.

4 () Ung real number codng meod ee wegh are coded o decmal and ued a chromoome. group of chromoome compre a populaon. So e orgnal oluon pace ha been mapped o earch pace of genec algorm. The leng of gene rng afer codng. Where m e number of L = m h + h n neuron n npu layer, h e number of neuron n hdden layer and n e number of neuron n oupu layer. (3) Ung mnmum opmzaon meod e fne funcon can be deermned. The formula of fne funcon a follow: f = = G m = j= ( j y j ) (8) Where e oal number of ample, m e number of neuron n oupu layer, G e global error of all of number of ample and y j e oupu of newor. (4) The wegh are opmzed ung genec algorm. We calculae e fne and perform e elecon w meod of roulee wheel elecon. Afer a, we copy e ndvdual w hgh fne no nex generaon of e populaon. The nex ep croover. We croover e ndvdual afer elecon w probably P c. Becaue we ue real number codng meod o code wegh no decmal, e algorm of croover hould be alered. If e croover performed beween e ndvdual and e ndvdual, e operand a follow: ( +) ndvdual afer muaon, a random daum of unform drbuon n c [ u mn δ, umax + δ +. Afer once of ee operaon, a new populaon generaed. By repeang e procedure of elecon, croover and muaon, e wegh combnaon adjued cloe enough o e mo opmzed wegh combnaon. (5) Fnally, rough e BP newor e wegh can be adjued delcaely. Tll now, e whole procedure of opmzaon end. W repec o every nd of predcon and analy problem n e coure of daa mnng, we exrac proper e of ranng ample and eng daa, ran maure neural newor model w above-menoned meod and apply e model o e fuure cae analy and predcon. 5. A REAL INSTANCE OF APPLICATION Fnally, we gve a real applcaon of daa mnng n e command cener of polce offce a example. In example we analye people gender, age, educaon degree, hory of crme, experence, peronal feaure, ocal relaon and economcal ncome. And we fnd a o ome exen ee facor affec people ocal acon a may lead people o comm a crme. Ung ee facor a npu varable, a genec neural newor can be ulzed o predc e preen crme pobly of ee people. 5. Clean The Daa n Daabae In e fr ep, we fll up e mng daa, moo e noe daa n daabae and olve e problem of ame name for dfferen meanng and dfferen name for ame meanng. And en, we load relaed daa no daa warehoue. 5. Selec Tranng Sample of BP Newor ] = c = ( c ) + ( c ) + c + + (9) Becaue n cae archve daabae e cae nformaon arranged n order of me, repreenave daa can be obaned by random amplng. So we elec ample by random amplng. To oban e ranng ample e of BP newor, we elec 5000 record from daa warehoue. In addon, we exrac oer 000 record a e eng ample e. Where croover, croover., + + +, + C 0,] Pm a par of ndvdual before a par of ndvdual afer a random daum of unform drbuon n [. W probably, we muae e ndvdual afer croover. If we muae e operand : = + c + ndvdual, e + (0) Where an ndvdual before muaon, an 5.3 rmalze Sample The mo mporan npu varable of BP newor nclude gender, age, educaon degree, crme hory, alary level and bad hab. The oupu of ample e au ( or ) of wheer people comm a crme a preen. The oupu of BP newor e probably of people preen au (Percenage) of crme. Table gve a l of fr 0 ample of e oal 5000 ranng ample.. Sex Age Educaon Degree M 5 Secondary chool M 3 Secondary chool Crme Hory Salary Level Preen Bad Sau of Hab Crme

5 3 M 40 Prmary 4 F 30 Prmary 5 F 7 Secondary 6 M 8 Unvery 7 M Junor 50 Unvery 8 M 38 Pograduae 9 M 70 Prmary 0 F 35 Hgh Table Value of Inpu Varable By normalzng above npu and oupu varable, e range of value of ee varable ha been mapped o e range of [0, ]. The mappng relaonhp gven a follow: 5.3. Gender Male:.0; Female: Age 0: 0.00; : 0.0; : 0.0; ; 00 and above: Table rmalzed Value of Inpu Varable 5.4 Buld BP Neural Newor and Begn o Tran Becaue ncludng above 6 mporan varable e oal number of npu varable 0, we deermned a e number of neuron n npu layer 0 and e number of neuron n oupu layer. Accordng o our experence and conformng o e prncple of mplfyng e newor rucure, we e e number of neuron n hdden layer o 6. W above parameer we buld 0 BP newor a have ame rucure. Then we generae 0 e of mall random number a nal wegh of ee newor and ue e exraced 5000 ample a npu and oupu ample of ee newor. Afer a, we ulze BP algorm o ran e newor and ge 0 e of raned wegh. The ranng me are 0. Afer ranng we e e newor w our eng ample e. The generalzaon ably of our fr newor hown a follow: Educaon Degree Illerae: 0.0; Graduae of Prmary : 0.5; Graduae of Secondary : 0.5; Graduae of Hgh : 0.375; Graduae of Junor Unvery: 0.5; Graduae of Unvery: 0.65; Pograduae: 0.75; Docor: 0.875; Po docor: Crme Hory :.0; : Y 00 G 00 G Salary Level ne: 0.0; Below 300 Yuan: 0.5; 300 Yuan: 0.5; 500 Yuan: 0.375; Yuan: 0.5; Yuan: 0.65; Yuan: 0.75; Yuan: 0.875; 5000 Yuan and above: Bad Hab :.0; : Preen Sau of Crme :.0; : 0.0 Table gve e value l of fr 0 ample of e oal 5000 ranng ample afer normalzaon.. Sex Age Educaon Degree Crme Hory Salary Level Bad Hab Preen Sau of Crme Fg. The Generalzaon Ably of BP Newor Where me of ranng, Y e value of error, G global error of ranng ample e and G global error of eng ample e. 5.5 Ulze Genec Algorm o Opmze e Wegh Value We code e 0 e of raned wegh by real number codng meod and ue e wegh afer codng a chromoome. 0 group of chromoome con of a populaon. Then we opmze ee wegh ung genec algorm unl e wegh afer decodng are adjued cloe enough o e mo opmzed wegh combnaon. 5.6 Ue e Opmzed Wegh o Tran e BP Newor Agan Fnally, we ue one of e BP newor o adju e opmzed wegh delcaely. The ranng me for adjumen are

6 4000. A a reul, e generalzaon ably of e newor hown below: Y G 0 G Fg. 3 The Generalzaon Ably of BP Newor 5.7 Apply e Traned Newor o Predcon and Analy We ue e fnally adjued wegh a e runnng wegh of BP newor o predc e probably of crme a people may comm a preen. The probably e oupu of e BP newor and a floa pon number repreenng e occurrence probably of even. The predcon reul hghly accurae. In real wor of e command cenre of polce offce, predcon reul can be ued o gude e monorng and racng agan e former crmnal. A e ame me, can a e loc and confrmaon of upec n cae deecon. So hghly ueful for cae olvng and decon-mang. 6. CONCLUSION BP neural newor a ha been appled o daa mnng poee characerc of hgh ably of memory, hgh adapably, accurae nowledge dcovery, none rercon o e quany of daa and fa peed of calculaon. Ung genec algorm o opmze e BP newor can effecvely avod e problem of local mnmum. Therefore, e genec neural newor baed daa-mnng model ha many advanage over oer daa mnng model. In e real pracce of daa mnng n e command cenre of polce offce, e advanage have been fully emboded. L Yang, 004. A Daa Mnng Archecure Baed on ANN and Genec Algorm. Compuer Engneer, 30(6), pp Guo Zhmao, 003. An Exenble Syem for Daa Cleanng. Compuer Engneer, 9(3), pp , 83 Qng Guofeng, 003. Acquremen of Knowledge on Daa Mnng. Compuer Engneer, 9(), pp. 0-. D.E.Goldberg, 99. Genec Algorm: A Bblography, IllGAL Techncal Repor, D.E.Goldberg, 989. Genec Algorm n Search, Opmzaon and Machne. Leanng, Addon-Weley. Srnva M., LAl M.Pana, 994. Genec Algorm: A Survey. IEEE Compuer, 7(6), pp Reference from Boo: Zhang Lmng, 993. The Model And Applcaon of Arfcal Neural Newor. Fudan Unvery Publher, Shangha. L Mngqang, 00. The Prncple and Applcaon of Genec Algorm. Scence Publher, Bejng. Davd Hard, 003. Prncple of Daa Mnng. Machne Indury Publher, Bejng. u Lna, 003. Neural Newor Conrol. Elecronc Indury Publher, Bejng. Beron Alex, Sm Sephen J. Daa Warehoung, Daa Mnng, &OLAP. McGraw-Hll Boo Co, 999. Reference from Journal: Aoyng Zhou, 005. A Genec-Algorm-Baed Neural Newor Approach for Shor-Term Traffc Flow Forecang. Advance n Neural Newor, 3498, pp Hecerlng Paul S, Gerber Ben S, 004. Ue of Genec Algorm for Neural Newor o Predc Communy- Acqured Pneumona. Arfcal Inellgence n Medcne, 30 (), pp u Zezhu, 004. A Daa Mnng Algorm Baed on e Rough Se Theory and BP Neural Newor. Compuer Engneer and Applcaon, 3, pp Wang Yu, 005. Predcve Model Baed on Improved BP Neural Newor and I Applcaon. Compuer Meauremen & Conrol, 3(), pp