Managing DMV Pictures & Signatures with Adabas Large Object (LOB) Fields Image storage on the mainframe

Transcription

1 Managing DMV Pictures & Signatures with Adabas Large Object (LOB) Fields Image storage on the mainframe Alan Peterson Technology Engineer IV

2 2 State of South Dakota Department of Public Safety upgrades Driver s License System Expanding size of Driver s license images > 32K. Adabas LOBs EntireX for > 32K transport Natural fields > 32K State Government

3 State of South Dakota 3 Population 814,180 (2010 Census) 46 th in the US. Density 10.9/sq mi - 46 th in the US. Area Total 77,116[2] sq mi(199,905 km2) - 17 th in the US Width 210 miles (340 km) Length 380 miles (610 km) State Capitol : Pierre (pronounced peer) WEB :

4 4 South Dakota Department of Public Safety responsible for Driver Licensing and State Identification cards. Started saving Driver s license images on ADABAS in 1991 Small Picture & Signature 10K contained both Backup / recovery Availability Natural V2.2 ADABAS v5.1

5 Driver s License file with Image file (old) 5 Driver s License Database 1 DL_Images IMAGE Database

6 Old Pictures ADABAS FDT fields that stored image. 6 Ty L Field ID F Length Occ D DB S. 1 PICTURE-DATA-1 B AN F 1 PICTURE-DATA-2 B AO F 1 PICTURE-DATA-3 B AP F 1 PICTURE-DATA-4 B AQ F 1 PICTURE-DATA-5 B AR F.. 1 PICTURE-DATA-16 B AV F 1 PICTURE-DATA-17 B AW F

7 Super Descriptor that tied records together 7 Ty L Field ID F Length Occ D DB S.. SP 1 OWN-KEY-QUAL-SEQ-SP A 13.0 D A4 N Source field(s) Start End DB PICTURE-OWNER 1 2 AA(1-2) PICTURE-KEY 1 9 AB(1-9) PICTURE-KEY-QUALIFIER 1 1 AC(1-1) PICTURE-SEQ-NO 1 1 AD(1-1)

8 New Drivers License changes 8 Facial recognition Separate picture and signature images Larger Picture up to 40K Larger Signatures up to 16K New Work station hardware Image format change required

9 Options for the images 9 Leave the same More records for larger images Key structure would have to change High data manipulation Move images to different platform; different DBMS Build interface between platforms Setup new platform structure/hardware Possible control/management issues Upgrade and modernize existing ADABAS V8 LOBs available Natural 4.2 large fields available EntireX messages > 32K ADABAS SVC could handle > 32K messages

10 Choose upgrade and modernize of existing system. 10 ADABAS LOBS Had been to Becky s internals class but had no other experience Started DBA testing June 2009 Natural Dynamic variables Had used in some arrays Hadn t used with Broker calls EntireX Broker Larger then 32K message Had to install new version (V8.0.1) Hadn t used messages > 32K

11 Driver s License File with Image file and LOB file. 11 Driver s License Database 1 DL_Images SAG-ADA-LOB IMAGE Database

12 New FDT image fields. Added to Base file DL_Images AB 000 A LB NB NU NV PHOTO 1 AC 000 A LB NB NU NV SIGNATURE ADALOD LOAD FILE=nnn LOBFILE=nnn

13 LOB file 13 Extra file required It contains data for LOBs specified in base file. ADALOD LOAD FILE=nnn,LOB BASEFILE=nnn ISNREUSE = YES DATAPFAC = 1 DSREUSE = YES ISNSIZE = 4

14 Predict LOB file listing. 14

15 Predict LOB file listing page 2. 15

16 Predict File definition

17 17 Predict Link Children maintenance screen of test file fields.

18 Predict Modify Large object field (screen 1) 18

19 Predict Modify Large object field (screen 2) 19

20 20 Predict listing of base file fields vs. SYSAOS FDT list of base file fields Predict file listing 1 KEY A 8.0 D AA N 1 PICTURE LO 140.0K AB N 1 SIGNATURE LO 16.0K AC N FDT listing TEST-PICTURES: 1 AA 008 A DE NU KEY 1 AB 000 A LB NB NU NV PICTURE 1 AC 000 A LB NB NU NV SIGNATURE

21 Predict DDM Long Alpha fields - Dynamic 21 Predict V4.5 Write U-GEN exit Activate exit Predict Generation Before execution y (y/n) Predict V4.6.1 Modify DDM Generation Long fields as DYNAMIC..* Y

22 DDM generated with Dynamic option OFF and ON 22 1 AB PICTURE A N LE= OPTIONS=LB 1 AC SIGNATURE A N LE=16384 OPTIONS=LB 1 AB PICTURE A N DY OPTIONS=LB 1 AC SIGNATURE A N DY OPTIONS=LB

23 23 Predict exit U-MIP Notification that file is related to another file. SYSDIC-FI-ADA FILE-NAME-ADA P-DBNR-FNR LOB-FNR Refresh/Purge base file TEST-PICTURES in database: 3 file: 87 is BASE file for LOB file: 88 database: 3 Do you want to continue enter (y/n) Refresh/Purge LOB file SAG-ADA-LOB in database: 3 file: 88 is LOB file for BASE: TEST-PICTURES Database: 3 file: 87 Do you want to continue enter (y/n)

24 NATURAL Dynamic Variables & related statements

25 Definition, Allocation & Usage 25 DEFINE DATA level variable-name ( A ) DYNAMIC level variable-name ( B ) DYNAMIC level variable-name ( U ) DYNAMIC *LENGTH(field) MOVE ALL UNTIL

26 Natural DDM for ADABAS file compared to FDT 26 DDM listing for TEST-PICTURES: 1 AA KEY A 8 N D 1 AB L@PICTURE I 4 1 AB PICTURE A N DY OPTIONS=LB 1 AC L@SIGNATURE I 4 1 AC SIGNATURE A N DY OPTIONS=LB FDT listing TEST-PICTURES: 1 AA 008 A DE NU KEY 1 AB 000 A LB NB NU NV PICTURE 1 AC 000 A LB NB NU NV SIGNATURE

27 Variable length images stored 27 READ TEST-PICTURES BY KEY DISPLAY *COUNTER KEY END CNT KEY Alan ALANb ALAN ALAN ALAN ALAN

28 EntireX Broker Attributes & Natural server

29 EntireX Broker Attributes 29 MAX-MSG-LENGHT = nnn,nnn EXTENDED-ACB-SUPPORT = YES IUBL = nnn,nnn CONVERSION = NO

30 Natural Broker Server - ACI 30 API-Version Send Area Receive Area *LENGTH(dynamic field) MOVE All UNTIL SUBSTRING

31 COBOL Direct Commands CICS COBOL program

32 AAMVA interface Problem Drivers Pointer System 32 NCSII Message Control UNI UNT040 Application Message UNST TDQ COBOL PGM1 Driver s License Images ACBX Direct Cmds COBOL PGM2 XML U010 TDQ XML U012 TDQ (image) UNI

33 Processing LOBs requires ACBX interface. 33 L3 direct call ADARSP253 error occurred processing a buffer APLX-FILLER low Value APLX-TOKEN low Value ABDXLOC buffer location Flag we set to I LOB Length LOB field value appended with 4 byte length of LOB. Length value includes length of LOB and 4 bytes of length field. ADABAS Utilities - ADACMP Utility: Compress- Decompress Data Field Definition Statements ADABAS Command Reference Guide DBA Tasks Large Object (LB) Files and Fields

34 Current Production January 2010

35 Driver s License Exam Station 35

36 Image sharing 36 EntireX Image Request Natural EAI Server ADABAS Web Server EAI Staff and Developer Mainframe

37 Current million old pictures Picture average size 7,888 bytes Signature average size 743 bytes.5 million new pictures Picture average size 35,551 bytes Signature average size 12,536 bytes.9 million licensees / id holders.8 gig dasd growth per month. DB backup under 30 minutes. 200, ,000 image records per year.

38 Read the documentation & TEST. Scan documentation for LOB. Remember different tools display the field information differently Alan Peterson Technology Engineer IV Bureau of Information and Telecommunications State of South Dakota Kneip Building 700 Governors Drive Pierre, SD Phone: (605) Contact Information here

39 The END

40 ADAREP LOB section 40 ************* * * * LOB FILES * :28:30 * * ************* FILE WITH I ASSOCIATED I LOB FIELDS I LOB FILE I I 88 I I I

41 Time Slot Tuesday, 10/16 11:15 12:00 Tuesday, 10/16 1:30 2:15 Adabas and Natural Track Presentations Managing DMV Pictures & Signatures with Adabas Large Object (LOB) October 16, Fields State of South Dakota Adabas and Natural Sessions for Process World 2012 Active Data Warehousing Made Easy with Adabas SQL Gateway Royal Bank of Canada Tuesday, 10/16 2:30 3:15 Tuesday, 10/16 3:30 4:15 Tuesday, 10/16 4:30 5:15 Wednesday, 10/17 11:15 12:00 Achieve Significant Quality Improvements by using Better Test Data with Data Masking for Adabas Pennsylvania State University What s next for Adabas and Natural? The Strategic Direction Software AG Case Study FSCJ: College Inventory Management using a Mobile Application Adabas Replication: How we do it at NYC DoITT New York City Department of Information Technology Wednesday, 10/17 1:30-2:15 Wednesday, 10/17 2:30-3:15 EntireX Broker Centralizes Drivers License Management State-Wide State of Virginia Natural Remote Data Collector (RDC); Monitoring and much more State of Washington Retirement System