DECART Quality Measurement Tools

Transcription

1 DECART Quality Measurement Tools João João Matos, Alexandre Gonçalves, Ricardo Sousa, Jaime Martins Instituto Superior Técnico

2 MOTIVATION 0

3 TO ILLUSTRATE THE APPLICABILITY OF THE CONCEPTS IN: Quality Principles; Quality Evaluation Procedures. TO PRESENT AN EXPLORATORY STUDY ON THE STRUCTURE OF A GENERIC QUALITY EVALUATION SOFTWARE..

4 OBJECTIVES FOR A GENERIC QUALITY EVALUATION SOFTWARE EXEMPLIFICATION FOR REAL CASES PROTOTYPE OF DECART IN IN A CAD ENVIRONMENT PROTOTYPE OF DECART IN IN A GIS ENVIRONMENT

5 1 OBJECTIVES FOR A GENERIC QUALITY EVALUATION SOFTWARE

6 CONFORMANCE TO 19113,19114 USE OF THE QUALITY ELEMENTS AND SUBQUALITY ELEMENTS COMPLETENESS CONSISTENCY POSITIONAL ACCURACY TEMPORAL ACCURACY THEMATIC ACCURACY

7 CONFORMANCE TO 19113,19114 USE OF THE CONCEPTS QUALITY EVALUATION METHOD DIRECT EVALUATION --EXTERNAL EVALUATION --INTERNAL EVALUATION REPORTING AS METADATA OR Q.E. REPORT

8 OPERATIONAL ISSUES SIMPLE MEASUREMENTS (NOT (NOT DEPENDENT DEPENDENT OF OF EXPENSIVE, EXPENSIVE, UNAVAILABLE UNAVAILABLE OR OR COMPLEX COMPLEX REFERENCE REFERENCE MEASUREMENTS) MEASUREMENTS) AUTOMATION EASYNESS OF REPORTING INTEGRATION ON THE PRODUCT LIFECYCLE

9 OPERATIONAL CONSTRAINTS DEPENDENCY ON AN UNDERLYING SOFTWARE DEPENDENCY ON METADATA APPLICATION

10 OPERATIONAL CONSTRAINTS MANY RESULTS ARE LIKELY TO NEVER BE REPORTED (e.g. (e.g. SOME SOME TOPOLOGICAL CONSISTENCY RESULTS, FORMAT CONSISTENCY). QEP CAN LEAD TO A REPORT OR TO THE EXECUTION OF THE PROCEDURES LEADING TO THE CONFORMANCE

11 2 INTERNAL EVALUATION

12 SPECIFICATIONS LINES LINES IN IN LAYER LAYER abc abc SHOULD SHOULD FORM FORM CLOSED CLOSED POLYGONS POLYGONS LINES LINES IN IN LAYER LAYER def def SHOULD SHOULD FORM FORM A CONNECTED CONNECTED GRAPH GRAPH LINES LINES IN IN LAYER LAYER ghi ghi ARE ARE RED RED AND AND WITH WITH LINETYPE LINETYPE CONTINUOUS CONTINUOUS ALL ALL POLYGONS POLYGONS OF OF THE THE THEME THEME HOUSES HOUSES SHOULD SHOULD HAVE HAVE A SPOT SPOT HEIGHT HEIGHT INSIDE INSIDE RAILWAYS RAILWAYS DO DO NOT NOT INTERSECT INTERSECT HOUSES HOUSES ELEVATIONS ELEVATIONS ARE ARE ALLWAYS ALLWAYS HIGHER HIGHER THAN THAN 0 AND AND LOWER LOWER THAN THAN 2000M 2000M CONTOURS CONTOURS ARE ARE HORIZONTAL HORIZONTAL LINES LINES......

13

14

15 3 EXTERNAL EVALUATION

16 De validação da carta 1/1000 de Lisboa.

17 Completeness Coefficient ICIST C = Qr Q + Q o r *100 Qr - represented quantity Qo - ommited quantity De Estudo para Validação da Carta 1/1000 de Lisboa (PROET).

18 COUNT ICIST Result of counting the number of objects or components Zona Método Comprimento (m) nº de Pontos Área (ha) Nº Polígonos Nº de linhas I A II III

19 ZONA OMITIDO REPRESENTADO nºentidades área omitida perímetro nº entidades área total perímetro total I II III IV V Quadro 1 - Omissões em entidades do tipo polígono (área em m 2 e perímetro em m).

20 ZONA OMITIDO REPRESENTADO nºentidades comprimento nº entidades comprimento I II III IV V

21 ZONA C nº área perímetro I 99,3 99,20 99,10 II 99,5 97,47 98,65 III 99,8 99,96 99,90 IV 99,9 99,97 99,94 V 99,7 99,5 99,57

22

23 BUFFERS ICIST Measurement of length inside the buffer Método 10m 20m 50m II-I 51% 84% 99% II-III 63% 92% 99% III-I 43% 77% 100%

24 A ICIST A ^~B ~A ^ B B B: A ^ B A: A ^ B

25

26 POSITIONAL ACCURACY X OMISSION ICIST 1 2 OBJECT X GRAPHICAL ELEMENT 2 1

27

28 1 2

29 PHOTOGRAMMETRIC SURVEY GROUND SURVEY ICIST De estudo para validação da carta 1/1000 de Lisboa (PROET/LTE). DIFFERENCE VECTORS (MAGNIFIED)

30 DISTANCE BETWEEN LINES ICIST MEAN OF THE DISTANCES IN VERTICES D D HAUSDORFF DISTANCE A B = A B = ( sup ( inf d ( x, y) )) x A y B ( sup ( inf d ( x, y) )) y B x A INNER AREA DISTANCE DH ( D A D ) = Max =, B B A

31

32 Different importance between systematic and random errors. 100m De estudo para a digitalização da REN (ICN).

33 TRANSFORMATION GAIN ICIST Diferença (Teste-Objecto) G = n ( p' i pi p' i p i ) 1 n " i= >70 Diferença (m) Transformação de 1º Grau Transformação de 3º Grau > More Diferença (m) Diferença (m) x σ x y σ y d σ d Objecto -Teste Objecto-P 1 (Teste) Objecto-P 3 (Teste)

34 ABSOLUT ERROR DIAGRAM RELATIVE ERROR DIAGRAM

35 Mangualde Abs-ori Mangualde Abs-Rel-Ori

36 Mangualde Abs-Grau Mangualde Abs-Rel-Grau

37 THE SOFTWARE 4

38 INTERNAL EVALUATION BASED ON SPECIFICATIONS AUTOMATED 100% INSPECTION PASS/FAIL

39 EXTERNAL EVALUATION REFERENCE DATA IS IS REQUIRED NOT ENTIRELY AUTOMATED INSPECTION BY SAMPLING

40 RESULTS: CORRECTION/REPORTING CORRECTION TOOLS AVAILABLE REPORTING TOOLS