DBugHelper: A Debug assistant tool for distributed systems

Transcription

1 ( ) Journal of East China Normal University (Natural Science) No. 5 Sept : (2016) DBugHelper: Debug,,, (, ) :,, Debug., Debug, bug., bug bug, bug.,, bug. bug bug. Debug DBugHelper, bug. DBugHelper bug,, bug,. bug, Debug,. : ; Debug; bug ; : TP391 : A DOI: /j.issn DBugHelper: A Debug assistant tool for distributed systems ZHANG Yan-fei, ZHANG Chun-xi, LI Yu-ming, ZHANG Rong (Institute for Data Science and Engineering, Shanghai Key Laboratory of Trustworthy Computing, East China Normal University, Shanghai , China) Abstract: Development of large-scale distributed systems has experienced a long developing period. During the whole development cycle, debug is one of the most important steps. We meet the challenges of finding all the bugs and the corresponding solutions fixing bugs in a short time. Bug reports record bug histories and solutions, which provide a way to understand bug features and help to find solutions for new bugs. After we analyze the bug reports and fixed solutions, we find that there are strong correlation and similarity among many large-scale distributed systems. Thus the developing and fixing scheme of : : 863 (2015AA015307); ( , ); ( ) :,,,. yfzhang@stu.ecnu.edu.cn. :,,,,. rzhang@sei.ecnu.edu.cn.

2 154 ( ) 2016 bugs may have similar characteristics. Then existed fixing solutions of bugs can be used to assist fixing new bugs. In this paper, we propose DBugHelper, a debug helping tool which can be applied to boost the development of large-scale distributed systems and provide a more effective way to fix bugs. In DBugHelper, the existed bug reports are processed offline, and the latest bug report is represented as a query vector. We query the bug report history database and find the similar bugs with their solutions. In such way, we suppose to shorten the whole system development period. Key words: large-scale distributed system; Debug; bug report; assistance 0 Debug,., ;.,,, : Spark HBase Cassandra Hadoop ; CouchDB MongoDB. bug, Debug.,, Debug. Debug bug,, Debug., bug., bug Debug. Kim S [1] bug, bug ; Zhou J [2], Nguyen A [3] bug, bug. Debug, bug bug, bug [3-4]. bug, 6. bug bug, bug., APACHE bug , bug [5] ; MapReduce bug 3 898, bug 1 435, bug 711 [5]. bug, bug, bug bug, bug, bug bug., bug, bug bug, bug,.

3 5, : DBugHelper: Debug 155, bug, bug [6] ; bug [7] ; (Orthogonal Defect Classification, ODC),,, [8]. bug, bug. Bug (, bug ) bug bug, bug., : bug bug,, : Q1: bug bug Q2: bug bug, : (1) : bug. Latent Dirichlet Allocation (LDA) [9-10], bug, ; (2) : LDA,, Vector Space Model(VSM) ; (3) : bug. LDA VSM bug, : LDA, bug,,, bug, ; VSM, bug,. DBugHelper LDA VSM L VSM,, bug. : LDA VSM L VSM, bug. bug,,. Debug DBugHelper. bug, bug. : 1 bug ; 2 DBugHelper ; 3 ; 4 ; 5 ; 6. 1 Bug bug, : bug : bug, bug, bug,.

4 156 ( ) 2016, bug., bug. : bug, bug. bug, bug,., bug, bug. :. bug,,.,. DBugHelper, bug, bug bug., bug bug [2]..,. 2 Debug DBugHelper 2.1 DBugHelper 1 Debug DBugHelper. : 1) : ; 2) :. bug,. bug L VSM, bug,., bug bug, bug, bug 1 DBugHelper Fig. 1 DBugHelper overview

5 5, : DBugHelper: Debug 157. bug bug, bug. 2.2, bug, L VSM bug, bug. DBugHelper bug F R,, bug F. : : bug, bug T s, bug ; bug bug T g ; T (T s + T g ). bug T, bug F T, F w. : T w, T w θ(t w) w T, w T, w w c = [w c,1, w c,2,, w c,t ], T, c, w c,t : w c,t = θ t,c T k=1 θ k,c. (1) w w uniform = [1/ T, 1/ T, 1/ T,, 1/ T ], 1/ T, cosine w c w uniform : simi c ( w c, w uniform ) = cos w c, w uniform = w c w uniform w c w uniform, (2).,. w D. : bug F T, T F w, w θ T., F, D. bug,,,. LDA,,,,,.,,. : D bug d, D F bug bug, F D t. bug, w i,j (tf) (idf).,. VSM, tf idf : tf i,j = n i,j k n k,j D, idf i = log {j : t i d j }. (3)

6 158 ( ) 2016 (3) n i,j t i d j, d j. D D d j, t j. tf, VSM, VSM [11]., : tf i,j = log(n i,j ) + 1. (4) L VSM, (4) tf, t i w i,j : D w i,j = tf i,j idf i = (log(n i,j ) + 1) log {j : t i d j }, (5) d j V j : V j = (w 1,j, w 2,j, w 3,j,, w i,j ). (6) L VSM LDA Gibbs Sampling, (2) bug, VSM, (6) F, : F = { V 1, V 2, V 3,, V D }. (7) : bug,,. bug,, bug. Bug K-Means [12],, K-Means bug. F K(K D ), F K, : S = {F 1, F 2, F 3,, F K }. (8) K, K,, K, K. K-Means : E = F n=1 k=1 K r nk ( V n µ k ) 2. (9) (9) µ k S k, r nk V n S n, 1, 0. E V n S n, k, : n µ k = r nk V n n r. (10) nk bug B, B.

7 5, : DBugHelper: Debug bug,.,, 2. bug, bug D B; S n C n ; bug. 2 DBugHelper Fig. 2 Three layers for online processing in DBugHelper B C n, B C n S B, (2) cosine B : simi(b i, C n ) = cos B i, C n. (11) B C n B, bug bug bug,. bug F, B S B bug, bug, bug DBugHelper, ( 1 ). bug, bug. HDFS,, Hadoop. MapReduce Hadoop,. HBase Hadoop, HDFS, MapReduce. Hive Hadoop,.

8 160 ( ) Tab. 1 Study project bugs bugs HDFS An open source distributed file system 17/Mar/09 1/May/ MapReduce An open source programming model 22/Jun/07 29/April/ HBase An open source distributed database 1/Feb/08 5/May/ Hive An open source distributed data warehouse 30/Oct/08 19/April/ , bug ( BugZilla APACHE ) bug, DBugHelper bug. bug, : (1) Bug. bug ( : MapReduce job can infinitely increase number of reducer resource requests, Bug, Blocker, 2.8.0, None ). (2) Bug. Debug bug,. 3.3 : Q1: DBugHelper bug, bug, bug DBugHelper. bug. Top N(N=1, 5, 10, 15, 20) bug, bug. 100 bug, bug (Accuracy). Q2: L VSM bug 2, L VSM, bug. L VSM, VSM, DBugHelper L VSM VSM, Q1 DBugHelper bug, L VSM. Q3: DBugHelper bug 2,,,, bug., (TA) ( ),. 3.4 DBugHelper bug, : Accuracy ( ) bug DBugHelper Top N(N=1,5,10,,n)., bug.,. TA( / ), Bug. TA DBugHelper,.

9 5, : DBugHelper: Debug 161 : TA = M P Time j j=1 M Accuracy (12) j=1 Time Top N bug ; M Top N bug ; Accuracy DBugHelper Top N bug. 4 M P Time j : Q1: DBugHelper bug 2 DBugHelper Top N bug bug bug, bug Top N. bug bug ( 100 bug ),. 100 HDFS bug, Top 10 44, 44%. Hive,, Top 20 68, 68%. N, DBugHelper. 2 DBugHelper Tab. 2 DBugHelper accuracy Top 1/% Top 5/% Top 10/% Top 15/% Top 20/% HDFS MapReduce HBase Hive Q2: L VSM bug DBugHelper, L VSM, bug. 3 VSM L VSM DBugHelper. HDFS MapReduce bug, Q1,, L VSM bug. 3, L VSM Top N(N=1, 5, 15, 20) bug VSM. HDFS MapReduce, L VSM VSM. VSM DBugHelper N, L VSM., L VSM bug bug. 3 VSM L VSM DBugHelper Tab. 3 Accuracy comparison between VSM and L VSM in DBugHelper VSM Top 1/% Top 5/% Top 10/% Top 15/% Top 20/% HDFS MapReduce L VSM Classic VSM L VSM Classic VSM

10 162 ( ) 2016 Q3: DBugHelper bug 4 Q1, Top N. HDFS 100 bug, 100 Top N(N=1, 5, 15, 20) bug,, bug 2. 4 DBugHelper Tab. 4 Execution time in DBugHelper Top 1/s Top 5/s Top 10/s Top 15/s Top 20/s HDFS MapReduce HBase Hive (12), TA DBugHelper. 3, TA N. Top 1 Top 5, ; Top 5 Top 20,.,. TA, DBugHelper. TA,, bug. DBugHelper, L VSM bug. VSM, L VSM ;,, Debug DBugHelper. 3 DBugHelper Fig. 3 The efficiency of DBugHelper 5, Debug. Bug, [13]. bug, bug bug. Lukins LDA bug, bug [14]. LDA bug,. DBugHelper bug, bug,., bug,. DBugHelper bug,, bug

11 5, : DBugHelper: Debug 163., bug bug. DBugHelper LDA VSM Bug, Rao [15] Unigram Model(UM), Vector Space Model(VSM), Latent Semantic Analysis Model(LSA), Latent Dirichlet Allocation Model(LDA) Cluster Based Document Model (CBDM), UM VSM. LDA VSM Bug,.., bug. bug bug, bug [16], bug [17], bug [1].,, bug,,., bug Debug. 6 bug, bug, bug., bug, bug,, bug., Debug. bug,, Debug DBugHelper. L VSM bug bug,., 4, DBugHelper bug., bug. DBugHelper,. [ ] [ 1 ] KIM S, ZIMMERMANN T, WHITEHEADE E J, et al. Predicting faults from cached history [C]//Proceedings of the 29th International Conference on Software Engineering [ 2 ] ZHOU J, ZHANG H, LO D. Where should the bugs be fixed? more accurate information retrieval-based bug localization based on bug reports [C]//Proceedings of the 2012 International Conference on Software Engineering. 2012: [ 3 ] NGUYEN A T, NGUYEN T T, AL-KOFAHI J, et al. A topic-based approach for narrowing the search space of buggy files from a bug report [C]//Proceedings of the IEEE/ACM International Conference on Automated Software Engineering. 2011: [ 4 ] ZHANG J, WANG X Y, HAO D, et al. A survey on bug-report analysis[j]. Science China, 2015, 58(2): [ 5 ] Hadoop Map/Reduce[EB/OL]. [ ]. [ 6 ] SUN X, LI B, LEUNG H, et al. MSR4SM: Using topic models to effectively mining software repositories for software maintenance tasks[j]. Information & Software Technology, 2015, 66: [ 7 ] HUANG L, NG V, PERSING I, et al. AutoODC: Automated generation of orthogonal defect classifications [J]. Automated Software Engineering, 2015, 22(1): 3-46.

12 164 ( ) 2016 [ 8 ] THUNG F, LO D, JIANG L. Automatic defect categorization [C]//Proceedings of the th Working Conference on Reverse Engineering (WCRE). IEEE, 2012: [ 9 ] BLEI D M, NG A Y, JORDAN M I. Latent Dirichlet allocation [J]. Journal of Machine Learning Research, 2003: [10] THOMAS S W. Mining software repositories using topic models [C]//Proceedings of the 33rd International Conference on Software Engineering. 2011: [11] MANNING C D, RAGHAVAN P, SCHÜTZE H. Introduction to Information Retrieval [M]. Cambridge: Cambridge University Press, [12] KANUNGO T, MOUNT D M, NETANYAHU N S, et al. An efficient k-means clustering algorithm: Analysis and implementation [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2002, 24(7): [13] SI X S, HU C H, ZHOU Z J. Fault prediction model based on evidential reasoning approach [J]. Science China Information Sciences, 2010, 53(10): [14] LUKINS S K, KRAFT N A, ETZKORN L H. Bug localization using latent Dirichlet allocation [J]. Information & Software Technology, 2010, 52(9): [15] RAO S, KAK A. Retrieval from software libraries for bug localization: A comparative study of generic and composite text models [C]//Proceedings of the International Working Conference on Mining Software Repositories. 2011: [16] PINGCLASAI N, HATA H, MATSUMOTO K. Classifying bug reports to bugs and other requests using topic modeling [C]//Proceedings of the Asia-Pacific Software Engineering Conference. IEEE Computer Society, 2013: [17] RUNESON P, ALEXANDERSSON M, NYHOLM O. Detection of duplicate defect reports using natural language processing [C]//Proceedings of the 29th International Conference on Software Engineering. 2007: ( : ) ( 143 ) [14] LAMB A, FULLER M, VARADARAJAN R, et al. The vertica analytic database: C-store 7 years later [C]//Proceedings of the VLDB Endowment. 2012: [15] CHANG L, WANG Z, MA T, et al. Hawq: A massively parallel processing sql engine in hadoop [C]//Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data [16] STONEBRAKER M, WEISBERG A. The VoltDB main memory DBMS [J]. IEEE Data Eng Bull, 2013: [17] BRYANT R E, O HALLARON D R. [M]. :, [18] ESWARAN K P, GRAY J N, LORIE R A, et al. The notions of consistency and predicate locks in a database system [J]. Communications of the ACM, 1976, 19(11): [19] STONEBRAKER M. One Size Fits None-(Everything You Learned in Your DBMS Class is Wrong) [R/OL]. ( )[ ]. [20] WEIKUM G, VOSSEN G. Transactional Information Systems: Theory, Algorithms, and the Practice of Concurrency Control and Recovery [M]. San Francisco: Morgan Kaufmann Publishers, [21] DIACONU C, FREEDMAN C, ISMERT E, et al. Hekaton: SQL server s memory-optimized OLTP engine [C]//Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data [22] MICHAEL M M. High performance dynamic lock-free hash tables and list-based sets [C]//Proceedings of the 14th Annual ACM Symposium on Parallel Algorithms and Architectures. 2002: [23] LAMPSON B W, STURGIS H E. Crash Recovery in a Distributed Data Storage System [R]. Palo Alto, California: Xerox Palo Alto Research Center, [24] SKEEN D. Nonblocking commit protocols [C]//Proceedings of the 1981 ACM SIGMOD International Conference on Management of Data [25] HAN J, HAIHONG E, LE G, et al. Survey on NoSQL database [C]//Proceedings of the th International Conference on Pervasive Computing and Applications. 2011: [26] O NEIL E J, O NEIL P E, WEIKUM G. The LRU-K page replacement algorithm for database disk buffering [C]//Proceedings of the ACM SIGMOD International Conference on Management of Data. 1993: ( : )