-3- TWO SOFTWARE PACKAGES FOR ARCHAEOLOGICAL QUANTITATIVE DATA ANALYSIS. S.G.H.Daniels 1, Gwendrock Villas, Fernleigh Road, Wadebridge, Cornwall



Similar documents
Current Standard: Mathematical Concepts and Applications Shape, Space, and Measurement- Primary

Dimensionality Reduction: Principal Components Analysis

Nonlinear Iterative Partial Least Squares Method

Introduction to Matrix Algebra

Common Core Unit Summary Grades 6 to 8

Engineering Problem Solving and Excel. EGN 1006 Introduction to Engineering

Big Ideas in Mathematics

MATH BOOK OF PROBLEMS SERIES. New from Pearson Custom Publishing!

STATISTICS AND DATA ANALYSIS IN GEOLOGY, 3rd ed. Clarificationof zonationprocedure described onpp

Chapter 6: The Information Function 129. CHAPTER 7 Test Calibration

CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C.

Knowledge Discovery and Data Mining. Structured vs. Non-Structured Data

Medical Information Management & Mining. You Chen Jan,15, 2013 You.chen@vanderbilt.edu

Linear Programming. March 14, 2014

Operation Count; Numerical Linear Algebra

THE NAS KERNEL BENCHMARK PROGRAM

Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.

How To Understand And Solve Algebraic Equations

Manifold Learning Examples PCA, LLE and ISOMAP

Project Scheduling in Software Development

MATH 0110 Developmental Math Skills Review, 1 Credit, 3 hours lab

In this chapter, you will learn improvement curve concepts and their application to cost and price analysis.

CORRELATED TO THE SOUTH CAROLINA COLLEGE AND CAREER-READY FOUNDATIONS IN ALGEBRA

NEW YORK STATE TEACHER CERTIFICATION EXAMINATIONS

DESCRIPTIVE STATISTICS. The purpose of statistics is to condense raw data to make it easier to answer specific questions; test hypotheses.

WESTMORELAND COUNTY PUBLIC SCHOOLS Integrated Instructional Pacing Guide and Checklist Computer Math

COLLEGE ALGEBRA IN CONTEXT: Redefining the College Algebra Experience

Mathematics. Mathematical Practices

Integer Factorization using the Quadratic Sieve

1. Classification problems

Model Virginia Map Accuracy Standards Guideline

Image Compression through DCT and Huffman Coding Technique

GRADES 7, 8, AND 9 BIG IDEAS

DATA ANALYSIS II. Matrix Algorithms

Structural Health Monitoring Tools (SHMTools)

Thnkwell s Homeschool Precalculus Course Lesson Plan: 36 weeks

Linear Threshold Units

Non-negative Matrix Factorization (NMF) in Semi-supervised Learning Reducing Dimension and Maintaining Meaning

Algebra Unpacked Content For the new Common Core standards that will be effective in all North Carolina schools in the school year.

Classification of Fingerprints. Sarat C. Dass Department of Statistics & Probability

How To Understand And Solve A Linear Programming Problem

Glencoe. correlated to SOUTH CAROLINA MATH CURRICULUM STANDARDS GRADE 6 3-3, , , 4-9

This unit will lay the groundwork for later units where the students will extend this knowledge to quadratic and exponential functions.

The number of marks is given in brackets [ ] at the end of each question or part question. The total number of marks for this paper is 72.

the points are called control points approximating curve

Content. Chapter 4 Functions Basic concepts on real functions 62. Credits 11

not possible or was possible at a high cost for collecting the data.

Grade 6 Mathematics Assessment. Eligible Texas Essential Knowledge and Skills

POLYNOMIAL FUNCTIONS

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

NUMERICAL METHODS TOPICS FOR RESEARCH PAPERS

business statistics using Excel OXFORD UNIVERSITY PRESS Glyn Davis & Branko Pecar

Joint models for classification and comparison of mortality in different countries.

Good FORTRAN Programs

BEHAVIOR BASED CREDIT CARD FRAUD DETECTION USING SUPPORT VECTOR MACHINES

Section 1.1. Introduction to R n

Multivariate Analysis of Ecological Data

For example, estimate the population of the United States as 3 times 10⁸ and the

Measurement with Ratios

1 Determinants and the Solvability of Linear Systems

Algebra I Credit Recovery

The Value of Visualization 2

SAS Software to Fit the Generalized Linear Model

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication

Figure 1. An embedded chart on a worksheet.

Summary. Chapter Five. Cost Volume Relations & Break Even Analysis

Regression III: Advanced Methods

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

Scatter Plots with Error Bars

Report Paper: MatLab/Database Connectivity

Measurement Information Model

with functions, expressions and equations which follow in units 3 and 4.

03 The full syllabus. 03 The full syllabus continued. For more information visit PAPER C03 FUNDAMENTALS OF BUSINESS MATHEMATICS

The Science and Art of Market Segmentation Using PROC FASTCLUS Mark E. Thompson, Forefront Economics Inc, Beaverton, Oregon

Diablo Valley College Catalog

Solving Simultaneous Equations and Matrices

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

Manhattan Center for Science and Math High School Mathematics Department Curriculum

Polynomial Operations and Factoring

South Carolina College- and Career-Ready (SCCCR) Pre-Calculus

ALGEBRA I (Common Core)

Optimal Design of α-β-(γ) Filters

Vertical Alignment Colorado Academic Standards 6 th - 7 th - 8 th

STATISTICA. Financial Institutions. Case Study: Credit Scoring. and

Intro to Data Analysis, Economic Statistics and Econometrics

ADVANCED APPLICATIONS OF ELECTRICAL ENGINEERING

Data Mining: Algorithms and Applications Matrix Math Review

Tomlinson, R. F Computer Mapping: An Introduction to the Use of Electronic Computers In the Storage, Compilation and Assessment of Natural and

Example: Credit card default, we may be more interested in predicting the probabilty of a default than classifying individuals as default or not.

Lecture 3. Linear Programming. 3B1B Optimization Michaelmas 2015 A. Zisserman. Extreme solutions. Simplex method. Interior point method

Package bigrf. February 19, 2015

How To Cluster

Using simulation to calculate the NPV of a project

Why Taking This Course? Course Introduction, Descriptive Statistics and Data Visualization. Learning Goals. GENOME 560, Spring 2012

Optimization Modeling for Mining Engineers

FOREWORD. Executive Secretary

Component Ordering in Independent Component Analysis Based on Data Power

Foundation of Quantitative Data Analysis

Position Classification Standard for Management and Program Clerical and Assistance Series, GS-0344

Industry Environment and Concepts for Forecasting 1

Transcription:

-3- TWO SOFTWARE PACKAGES FOR ARCHAEOLOGICAL QUANTITATIVE DATA ANALYSIS S.G.H.Daniels 1, Gwendrock Villas, Fernleigh Road, Wadebridge, Cornwall The two analytical packages AQUA and ARCHON share many features and capabilities. Both are designed primeupily for use in projects with medium to large quantities of data, where many different aneülytical questions may be asked about the same data base«various data storage forms, reasonably close to those in which sirchaeologists record information, are provided, together with facilities for addition to and alteration of the data base, and extraction of subsets of data. Output is intended to be readily understood by archaeologists unfamiliar with computers and entities are identifiable by full names rather than coded abbreviations. Graphic output via pen plotter or line printer is normally available in addition to numerical output. Both packages are modular in construction so as to make expansion for further applications rapid and comparatively painless. AQUA, which is the property of the Centre for Nigeriam Cultural Studies, Ahmadu Bello University, Zsiria, Nigeria, is a 12,000-statement package in FORTRAN. It was written for use on a CDC CYBER-72 smd for compilation by the University of Minnesota FORTRAN compiler (MNF), but conforms to ANSI standards as far as possible. Graphic output was designed for a CALCOMP 563 pen plotter and requires the availability of the CALCOMP PLOT library. The full package contsdns a shell of control language segments which execute programs, and handle files and error conditions under the operating system NOS 1.1.0-'t30B» However the

-4- FÛRTRAN programs can be modified for use independently or within a similar shell designed for another operating system. A l80-page manual contains user instructions, algebraic descriptions of algorithms, details of data storage conventions and necessary information for conversion to another computing environment. '.Vhile I was writing AQUA the system was underutilised and economy of time and storage space was therefore largely sacrificed to the then over-riding priority of producing usable results as soon as possible. In the earliest stages the package was intended for an ICL I90O computer with no remote termineüls. Successive modifications, of concept and detail, adapted it to the CDC CYBER, through FTN and MNF to ANSI FORTRAN, and to use from a remote terminal. The final package shows fossilised traces of this process, including an unnecessary rigidity, much inelegant programming, and an interactive character which is only partial, in that interaction is with the control language shell, not with the individual programs, ARCHON is now in process of development. It is currently about the same size as AQUA, but not yet of the same power. It is written for a Tandy TRS-80 Model 1 micro-computer, with at least 32K RAM, at least 2 mini-floppy disk drives, and a 120-column line printer. The graphic portions make use of a Houston Instruments HI-PLOT flat bed pen plotter and HI-PAD digitizing pad, communication being by RS-232-C interface. The package is written in Radio-Shack Level 2 BASIC with some machine code segments, though portions will soon be rewritten in Radio-Shack FORTRAN for greater speed. Operation is fully interactive and 'friendly'. Processing large bodies of data can be very slow, but overall time from formulating the problem to obtsdning the results can compare

-5- favourably with time-sharing on a mainframe where scheduling is not under the user's control. Considerable attention has been psdd to economy of time and storage space, making it possible to tackle realistically large quantities of data using ^8K RAM. Some features, though common to the two packages, have been improved in ARCHON. Nearly all input and output, as well as frequent mathematical operations, axe handled by pre-written subroutines which can be inserted into new programs sis required. Addition of new programs is therefore faster and less error-prone. Intelligibility has also been inproved, with output ready for immediate inclusion in a coherent analytical project report. File handling is more flexible and more data storage forms are catered for. ARCHON is my own property and portions of it can be made available on a commercial basis from autumn I980. Familiar capabilities of one or both packages include basic univaxiate statistics, cross -> tabulations, regression and principal components, while graphic options cover, amongst others, histograms, bivariate scattergrams, 3-pole graphs, distribution and location maps, contour plots and isometric and perspective views of surfaces. There are also a range of non-standard analytical techniques developed for archaeologiceil work sind as yet unpublished, partly published or iinfamiliso". These include: - Lentifer einalysis. This is a multi-dimensional scaling procedure designed to recover underlying variables of which observed data are approximate lenticular functions. The procedure may be applied to any data in which individual objects - have been classified as members of two or more groups (whether assemblages or observational categories), and to square or rectangular matrices. It is metric and uses no intermediate difference

-6- : ;. ".' «coefficient, being applicable directly to raw or proportional frequencies and presence/absence data. Solution for each dimension does not affect those silready found for previous dimensions. The algorithm, which is iterative and comparatively rapid, attempts to minimise within-group variance. I have not met solutions which were non-global minima, though I can not demonstrate this as a theoretical rule. The output is a configuration of points in the solution space, each point standing for a group. Ramal einalysis. This is intended for the recovery of brgmching trees from a matrix of interpoint distances, the distances being given by:- hi = - ^ 82^d where is the proportion of elements in the same state in two systems. The tree found differs from most in that there is in general no point on the tree from which all the terminal points are equidistaint. The difference matrix generates a rameil matrix, in which the element in row i^ and column ^ is the estimated network distance from an surbitrary root to the point at which the paths to i^ and j^ diverge. A series of ramifications then replaces this by a ramified form (a ramal matrix which meets the ultrametric constraints required for a real tree), while attempting to minimise the sum of squared differences between initisil ramal matrix and ramified form. This procedure is repeated iteratively until stable estimates are obtained for the ramified form. Ramifications can be very lengthy for Isirge data, but iterations are usually very few» The solution is not unique, in that it is given in terms of «in arbitrary root, and an infinity of equally well fitting solutions correspond to different positions of the root. A unique rooted solution can be

-7- obtedned by requiring that the variaince of the distances from root to terminal points be minimal. Delta technique. Intended for classical one-dimensional seriation, this aû.gorithm operates on a difference or similarity matrix and requires only addition and subtraction. For matrices up to about 12 X 12 it is perfectly feasible vd.th a pocket calculator. With the units arranged in a given arbitrary order a set of estimates 6.^«for the distemce between i, and j, are ^'^ obtained using only those units preceding i_ and following j. If every 6 is positive the order is consistent amd is accepted as a solution. If suiy 6 is negative, it is taken to imply that the two assemblages concerned are in the wrong order. In this case the pair of units with the absolutely smallest 6 is transposed and the procedure repeated. It is arithmetically possible for a given set of data to have no consistent order, or more than one consistent order, but I have not encountered this with real archaeological data and metric differences, where a consistent order (apparently unique) has always been reached. Mapping of character space into real space-time. Given the reduced-space output of some multidimensional scaling technique, the aim is to show how this space relates to the geographiccll space or space-time from which the assemblages or objects were drawn. A vector function is obtedned which gives the approximate location of a point in character space as a function of its location in reïü. space. In AQUA the elements of this function are polynomials of arbitrary degree, while in ARCHON they are a piece-wise approximation by splines. For einy given region of the real space, the function gives a region of a particular size in the character space, and the ratio of the latter to the former will vary across the real space.

-8- This ratio exists at a point in the real space, and it is this which is plotted to show the relationship between the two spaces. Regions of the real space in which the ratio is low are those in which the assemblages are generally similar. Regions where the ratio is high are those where adjacent assemblages are comparatively different. The degree of the function, taken together with the number of assemblages and the amount of reduction in the character space, results in more or less 'smoothing' of the variation in ratio values. With a function of suitable degree regions of cultural similarity are revealed as low-valued basins sepaj:"ated by high-valued ridges of dissimilarity. Ramal analysis is treated fully in Daniels (I968), and I hope soon to be able to publish concise but full details of the other techniques available in AQUA and ARCHON Daniels, S.G.H, Ramal analysis and evolutionary trees, W,Afr.J,Archaeol., 8. I978 (In press)