Network-Based and Host- Based Intrusion Detection. Harley Kozushko. Graduate Seminar



Similar documents
Intrusion Detection Systems

Network- vs. Host-based Intrusion Detection

CS 356 Lecture 17 and 18 Intrusion Detection. Spring 2013

Outline Intrusion Detection CS 239 Security for Networks and System Software June 3, 2002

Introduction... Error! Bookmark not defined. Intrusion detection & prevention principles... Error! Bookmark not defined.

Intrusion Detection. Tianen Liu. May 22, paper will look at different kinds of intrusion detection systems, different ways of

Module II. Internet Security. Chapter 7. Intrusion Detection. Web Security: Theory & Applications. School of Software, Sun Yat-sen University

For more information on SQL injection, please refer to the Visa Data Security Alert, SQL Injection Attacks, available at

Introduction of Intrusion Detection Systems

Network Based Intrusion Detection Using Honey pot Deception

Name. Description. Rationale

2. From a control perspective, the PRIMARY objective of classifying information assets is to:

Performance Evaluation of Intrusion Detection Systems

State of Vermont. Intrusion Detection and Prevention Policy. Date: Approved by: Tom Pelham Policy Number:

GFI White Paper PCI-DSS compliance and GFI Software products

Rule 4-004M Payment Card Industry (PCI) Monitoring, Logging and Audit (proposed)

Intrusion Detection Systems Submitted in partial fulfillment of the requirement for the award of degree Of Computer Science

INTRUSION DETECTION SYSTEMS and Network Security

Using Automated, Detailed Configuration and Change Reporting to Achieve and Maintain PCI Compliance Part 4

The SIEM Evaluator s Guide

Firewalls Overview and Best Practices. White Paper

Intrusion Detection and Cyber Security Monitoring of SCADA and DCS Networks

A Review of Anomaly Detection Techniques in Network Intrusion Detection System

Firewalls, Tunnels, and Network Intrusion Detection

Privileged. Account Management. Accounts Discovery, Password Protection & Management. Overview. Privileged. Accounts Discovery

The Comprehensive Guide to PCI Security Standards Compliance

SOUTHERN POLYTECHNIC STATE UNIVERSITY. Snort and Wireshark. IT-6873 Lab Manual Exercises. Lucas Varner and Trevor Lewis Fall 2013

B database Security - A Case Study

LogRhythm and PCI Compliance

CorreLog Alignment to PCI Security Standards Compliance

IDS / IPS. James E. Thiel S.W.A.T.

HONEYPOT SECURITY. February The Government of the Hong Kong Special Administrative Region

PROFESSIONAL SECURITY SYSTEMS

Oracle Maps Cloud Service Enterprise Hosting and Delivery Policies Effective Date: October 1, 2015 Version 1.0

NETWORK AND AIS AUDIT, LOGGING, AND MONITORING POLICY OCIO TABLE OF CONTENTS

WHITE PAPER PROCESS CONTROL NETWORK SECURITY: INTRUSION PREVENTION IN A CONTROL SYSTEMS ENVIRONMENT

Data Security Incident Response Plan. [Insert Organization Name]

FISMA / NIST REVISION 3 COMPLIANCE

Taxonomy of Intrusion Detection System

Tripwire Log Center NEXT GENERATION LOG AND EVENT MANAGEMENT WHITE PAPER

Tripwire Log Center NEXT GENERATION LOG AND EVENT MANAGEMENT WHITE PAPER

CS 356 Lecture 25 and 26 Operating System Security. Spring 2013

AUGUST 28, 2013 INFORMATION TECHNOLOGY INCIDENT RESPONSE PLAN Siskiyou Boulevard Ashland OR 97520

Basics of Internet Security

RSA envision. Platform. Real-time Actionable Security Information, Streamlined Incident Handling, Effective Security Measures. RSA Solution Brief

Intrusion Detection System Based Network Using SNORT Signatures And WINPCAP

NIST CYBERSECURITY FRAMEWORK COMPLIANCE WITH OBSERVEIT

DEFENSE THROUGHOUT THE VULNERABILITY LIFE CYCLE WITH ALERT LOGIC THREAT AND LOG MANAGER

TABLE OF CONTENT. Page 2 of 9 INTERNET FIREWALL POLICY

LOG AND EVENT MANAGEMENT FOR SECURITY AND COMPLIANCE

Anatomy of a Breach: A case study in how to protect your organization. Presented By Greg Sparrow

California State University, Chico. Information Security Incident Management Plan

Principles of Information Security, Fourth Edition. Chapter 12 Information Security Maintenance

Architecture Overview

FIREWALL CHECKLIST. Pre Audit Checklist. 2. Obtain the Internet Policy, Standards, and Procedures relevant to the firewall review.

Application Intrusion Detection

Intrusion Detection System (IDS)

IBM SECURITY QRADAR INCIDENT FORENSICS

White Paper. Protecting Databases from Unauthorized Activities Using Imperva SecureSphere

LogRhythm and NERC CIP Compliance

An Inspection on Intrusion Detection and Prevention Mechanisms

Cisco Advanced Services for Network Security

Advancement in Virtualization Based Intrusion Detection System in Cloud Environment

How To Manage Security On A Networked Computer System

Firewalls, Tunnels, and Network Intrusion Detection. Firewalls

TASK TDSP Web Portal Project Cyber Security Standards Best Practices

CSCI 4250/6250 Fall 2015 Computer and Networks Security


IntruPro TM IPS. Inline Intrusion Prevention. White Paper

The Payment Card Industry (PCI) Data Security Standards (DSS) v1.2 Requirements:

Host Hardening. Presented by. Douglas Couch & Nathan Heck Security Analysts for ITaP 1

SolarWinds Security Information Management in the Payment Card Industry: Using SolarWinds Log & Event Manager (LEM) to Meet PCI Requirements

MANAGED FILE TRANSFER: 10 STEPS TO SOX COMPLIANCE

Managed Security Services for Data

Intrusion Detection Systems and Supporting Tools. Ian Welch NWEN 405 Week 12

Bridging the gap between COTS tool alerting and raw data analysis

Ethical Hacking Agreement for External Network Security Unannounced Penetration Test

Passive Logging. Intrusion Detection System (IDS): Software that automates this process

PCI DSS Requirements - Security Controls and Processes

Effective Threat Management. Building a complete lifecycle to manage enterprise threats.

THE ROLE OF IDS & ADS IN NETWORK SECURITY

Guideline on Auditing and Log Management

Radware s Behavioral Server Cracking Protection

Intrusion Detection Systems. Overview. Evolution of IDSs. Oussama El-Rawas. History and Concepts of IDSs

Intruders & Intrusion Hackers Criminal groups Insiders. Detection and IDS Techniques Detection Principles Requirements Host-based Network-based

Top Five Data Security Trends Impacting Franchise Operators. Payment System Risk September 29, 2009

The Need for Real-Time Database Monitoring, Auditing and Intrusion Prevention

How To Manage Sourcefire From A Command Console

Transcription:

Network-Based and Host- Based Intrusion Detection Graduate Seminar 1

Goal This presentation is an in-depth overview of intrusion detection. As such, the purpose of the presentation is for reference. 2

Overview The need for intrusion detection systems. Why Firewalls aren t enough. Definition of intrusion detection systems. Host and network-based architectures. Centralized and distributed architectures. 3

Overview cont. Comparison of host-based and networkbased benefits Audit policies Detection engine that identifies patterns of misuse. Signatures 4

Overview cont. Statistical Analysis Neural networks Support vector machines Automated Response Behavioral data forensics Monitoring User-centric Target-centric 5

Overview cont. Operational modes Background On-demand Scheduled Real-time 6

The Need for Intrusion Detection Recent explosion in the market for intrusion detection systems. $40 million in 1997 to $100 million in 1998 This growth was driven by reports of increasing security breaches. Incidents 90000 80000 70000 60000 50000 40000 30000 20000 10000 0 Number of Incidents Reported 21,756 52,658 82,094 76,404 2000 2001 2002 1Q-2Q 2003 Year 7

The Need for Intrusion Detection Vulnerabilities are also up Vulnerabilities Reported Vulnerabilities 4,500 4,000 3,500 3,000 2,500 2,000 1,500 1,000 500 0 2000 2001 2002 1Q-2Q 2003 Year 8

The Need for Intrusion Detection Because the number of attacks and vulnerabilities are rising, network administrators are looking to extend firewalls. 9

Why Firewalls Aren t Enough Firewalls act as a barrier between the network, which is internal to the company and the outside world. This barrier is created by filtering incoming traffic according to a security policy. 10

Why Firewalls Aren t Enough This would be sufficient if it wasn t for: Not all access comes through the firewall Users sometimes set up unauthorized modem connections between their systems that are connected to the network and outside internet service providers. The firewall cannot mitigate what it doesn t see. 11

Why Firewalls Aren t Enough Not all threats originate from outside of the firewall. The vast majority of loss is due to security breaches is traced to inside the company. Again, the firewall only sets barriers between the internal network and the internet. 12

Why Firewalls Aren t Enough Firewalls are subject to attacks themselves Attack strategies for circumventing firewalls have been widely publicized. For example tunneling, that is, encapsulating a message in one protocol that might be blocked by firewall filters, inside a second message. 13

Definition of Intrusion Detection Systems Intrusion Detection encompasses event log analysis for insider threat detection; network traffic analysis for threat detection; security configuration management; and file integrity checking 14

Definition of Intrusion Detection Systems Intrusion detection is based on analyzing a set of discrete, time-sequenced events for patterns of misuse. Intrusion detection sources are sequential records that reflect specific actions and indirectly reflect behavior. 15

Definition of Intrusion Detection Systems Host-based technology Examines events like what files were accessed and what applications were executed. Network-based technology Examines events as packets of information exchange between computers (network traffic). 16

Network-Based Intrusion Detection The system is used to analyze network packets. 2 Types: Promiscuous-mode technology that sniffs all the packets on a network segment for analysis. This done by placing a sensor on every segment. Network-node just sniffs the packets bound for a single destination computer. Characterized by a set of distributed agents on mission critical machines. 17

Network-Based Intrusion Detection Systems A standard network intrusion detection architecture. A sensor is used to sniff packets off the network where they are fed into a detection engine which will set off an alarm if any misuse is detected. A central console is used to collect the alarms from multiple sensors 18

Network-Based Intrusion Detection Systems In order to better understand the network architecture, the lifecycle of a network packet needs to be examined. 19

Network Packet Lifecycle The network packet is created when one computer communicates with another. Network Sensor TCP/IP Records 1 Network Packets 20

Network Packet Lifecycle The packet is read in real-time off the network through a sensor. The sensor is usually a stand alone machine or network device. Network Sensor TCP/IP Records 1 Network Packets Command Console Detection Engine 2 21

Network Packet Lifecycle A sensor-resident detection engine is used to identify predefined patterns of misuse. If a pattern is detected, an alert is generated and forwarded to the central console. Network Sensor TCP/IP Records 1 Network Packets Command Console Detection Engine 2 4 Alert 3 Log 22

Network Packet Lifecycle Network Sensor Command Console The security officer is notified about the misuse. TCP/IP Records 1 Detection Engine 2 3 Network Packets Log 5 4 Alert Security Officer 23

Network Packet Lifecycle A response to the misuse is generated. The response subsystem matches alerts to pre-defined responses or can take responses from the security officer. Network Sensor TCP/IP Records 1 Network Packets 5 Security Officer Command Console Detection Engine 2 4 Alert 3 Log 6 Response Subsystem 24

Network Packet Lifecycle The alert is stored for correlation and review at a later time. Network Sensor TCP/IP Records 1 Network Packets Command Console Detection Engine 2 3 Log 5 Security Officer 4 Alert 7 base 6 Response Subsystem 25

Network Packet Lifecycle Reports are generated that summarize the alert activity. Network Sensor TCP/IP Records 1 Network Packets Command Console Detection Engine 2 3 Log 5 Security Officer 4 Alert 7 base 6 Response Subsystem 9 Reports 26

Network Packet Lifecycle Network Sensor Command Console forensics is used to detect long-term trends. TCP/IP Records 1 Network Packets Detection Engine 2 3 Log 5 4 Alert 6 Security Officer Response Subsystem 8 Forensics 7 base 9 Report 27

Network-Based Intrusion Detection Systems A few years ago all commercial network intrusion detection systems used promiscuous-mode sensors However, these technologies were subjected to packet loss on high speed networks 28

Network Intrusion Detection Systems A new architecture dealt with the performance problem by distributing sensors to every computer on the network. In network-node intrusion detection each sensor is concerned only with packets directed at the target in which the sensor resides. The sensors then communicate with each other and the main console to aggregate and correlate alarms. 29

Network Intrusion Detection Systems However, it has added to the confusion over the differences between host-based and network-based intrusion detection. A network sensor that is running on a host machine does not make it a host-based sensor. Network packets directed to a host and sniffed at a host is still considered network intrusion detection. 30

Distributed Network-Based Architecture An agent is used to read packets off the TCP/IP stack layer where the packets have been reassembled. The packet is then fed into the detection engine located on the target machine. Network-node agents communicate with each other on the network to correlate alarms at the console. 31

Distributed Network IDS Lifecycle A network packet is created. Network Sensor TCP/IP Records Network Packets Command Console Forensics Report Detection Engine Local Response Alert base Security Officer 32

Distributed Network IDS Lifecycle The packet is read in realtime off the network through a sensor resident on the destination machine. Network Sensor TCP/IP Records Network Packets Detection Engine Security Officer Local Response Alert Command Console Forensics Report base 33

Distributed Network IDS Lifecycle A detection engine is used to identify predefined patterns of misuse. If a pattern is detected, an alert is generated and forwarded to a central console or to other sensors in the network. Network Sensor TCP/IP Records Network Packets Detection Engine Security Officer Local Response Alert Command Console Forensics Report base 34

Distributed Network IDS Lifecycle The security officer is notified. Network Sensor TCP/IP Records Network Packets Command Console Forensics Report Detection Engine Local Response Alert base Security Officer 35

Distributed Network IDS Lifecycle A response is generated. Network Sensor TCP/IP Records Network Packets Command Console Forensics Report Detection Engine Local Response Alert base Security Officer 36

Distributed Network IDS Lifecycle The alert is stored for later review and correlation. Network Sensor TCP/IP Records Network Packets Command Console Forensics Report Detection Engine Local Response Alert base Security Officer 37

Distributed Network IDS Lifecycle Reports are generated summarizing alert activity. Network Sensor TCP/IP Records Network Packets Command Console Forensics Report Detection Engine Local Response Alert base Security Officer 38

Distributed Network IDS Lifecycle forensics is then used to look for long-term trends. Network Sensor TCP/IP Records Network Packets Detection Engine Local Response Alert Command Console Forensics Report base Security Officer 39

Operational Modes However, the architectures require operational modes in order to operate. Operational modes describe the manner the intrusion detection system will operate and partially describe the end goals of monitoring. 40

Operational Modes Two primary operational modes to use network intrusion detection Tip-off The system is used to detect misuse as it is happening. By observing patterns of behavior, suspicious patterns can be detected to tip-off the officer that misuse may be occurring. 41

Operational Modes Surveillance Characterized by an increased observance of the behavior of a small set of subjects. Takes place when misuse has already been suspected. Surveillance results from a tip-off from either the intrusion detection system or another indicator. 42

Host-Based Intrusion Detection Used to analyze data that originates on the computers, such as application and operating system event logs and file attributes. That data is then scanned for pre-defined patterns of misuse Becoming increasingly important because of the insider threat. 43

Host-Based Intrusion Detection Host event logs contain information about file accesses and program executions associated with inside users. This proximity also provides excellent trending and damage control assessments. If protected correctly, event logs may be entered into court to support prosecution of computer criminals. 44

Host-Based Intrusion Detection Host-based systems guard against: Abuse of privilege When a user has root, administrative or some other privilege and uses it in an unauthorized manner. Contractors with elevated privileges When an administrator gives a contractor elevated privileges to install an application, but forgets to remove those privileges. 45

Host-Based Intrusion Detection Ex-employees utilizing their old accounts Policies to delete accounts when individuals leave might take time, leaving a window for a user to log back in. Modifying website data Against government agencies in particular, that result in uncomplimentary remarks posted on web sites. While these attacks originate from outside the network, they are perpetrated on the machine itself. 46

Host-Based Intrusion Detection Architecture In the centralized architecture, data is forwarded to an analysis engine running independently from the target. In the distributed architecture, raw data is analyzed in real time on the target first and then only alerts are sent to the command console. 47

Host-Based Intrusion Detection Architecture An even record is created. This occurs when an action happens; such as a file is opened or a program is executed. Target Audit Subsystem Audit Raw Centralized Security Officer Forensics Command Console Detection Engine Alert Base Log Response Subsystem Report 48

Host-Based Intrusion Detection Architecture The target agent transmits the file to the command console. This happens at predetermined time intervals over a secure connection. Target Audit Subsystem Audit Raw Centralized Security Officer Forensics Command Console Detection Engine Alert Base Log Response Subsystem Report 49

Host-Based Intrusion Detection Architecture The detection engine, configured to match patterns of misuse, processes the file. Target Audit Subsystem Audit Raw Centralized Security Officer Command Console Detection Engine Alert Log Response Subsystem Forensics Base Report 50

Host-Based Intrusion Detection Architecture A log is created that becomes the data archive for all the raw data that will be used in prosecution. Target Audit Subsystem Audit Raw Centralized Security Officer Forensics Command Console Detection Engine Alert Base Log Response Subsystem Report 51

Host-Based Intrusion Detection Architecture An alert is generated. When a predefined pattern is recognized, such as access to mission critical file, an alert is forwarded to a number of various subsystems for notification, response and storage. Target Audit Subsystem Audit Raw Centralized Security Officer Command Console Detection Engine Alert Log Response Subsystem Forensics Base Report 52

Host-Based Intrusion Detection Architecture The Security officer is notified. Target Audit Subsystem Command Console Audit Raw Centralized Detection Engine Log Security Officer Alert Response Subsystem Forensics Base Report 53

Host-Based Intrusion Detection Architecture A response is generated. The response subsystem matches alerts to predefined responses or can take response commands from the security officer. Target Audit Subsystem Audit Raw Centralized Security Officer Forensics Command Console Detection Engine Alert Base Log Response Subsystem Report 54

Host-Based Intrusion Detection Architecture The alert is stored. Target Audit Subsystem Command Console Audit Raw Centralized Detection Engine Log Security Officer Alert Response Subsystem Forensics Base Report 55

Host-Based Intrusion Detection Architecture The raw data is transferred to a raw data archive. Target Audit Subsystem Audit Raw Centralized Command Console Detection Engine Log Security Officer Forensics Alert Base Response Subsystem Report 56

Host-Based Intrusion Detection Architecture Reports are generated. Reports can be a summary of the alert activity. Target Audit Subsystem Audit Raw Centralized Security Officer Command Console Detection Engine Alert Log Response Subsystem Forensics Base Report 57

Host-Based Intrusion Detection Architecture forensics is used to locate long-term trends and behavioral is analyzed using both the stored data in the database and the raw event log archive. Target Audit Subsystem Audit Raw Centralized Security Officer Forensics Command Console Detection Engine Alert Base Log Response Subsystem Report 58

Host-Based Intrusion Detection Architecture Distributed real-time architecture Similar to centralized architecture except that the record is discarded after the target detection engine analyzes it. The advantage is that everything happens in real-time. The disadvantage is that the end users suffer from performance degradation. 59

Distributed Host-Based Architecture An event record is created. Target Audit Subsystem Audit Command Console Forensics Report Detection Engine Local Response Alert Base Security Officer 60

Distributed Host-Based Architecture The file is read in real-time and processed by a target resident detection engine. Target Audit Subsystem Audit Detection Engine Security Officer Local Response Alert Command Console Forensics Base Report 61

Distributed Host-Based Architecture The security officer is notified. Some systems notify directly from the target, while others notify from a central console. Target Audit Subsystem Audit Detection Engine Security Officer Local Response Alert Command Console Forensics Base Report 62

Distributed Host-Based Architecture A response is generated. The response may be generated from the target or console. Target Audit Subsystem Audit Detection Engine Security Officer Local Response Alert Command Console Forensics Base Report 63

Distributed Host-Based Architecture An alert is generated then sent to a central console. Target Audit Subsystem Audit Command Console Forensics Report Detection Engine Local Response Alert Base Security Officer 64

Distributed Host-Based Architecture The alert is stored. Statistical behavioral data outside alert data are not usually available in this architecture. Target Audit Subsystem Audit Detection Engine Security Officer Local Response Alert Command Console Forensics Base Report 65

Distributed Host-Based Architecture forensics is used to search for longterm trends. However, because there is no raw data archive and no statistical data, this capacity is limited. Target Audit Subsystem Audit Detection Engine Local Response Alert Command Console Forensics Base Report Security Officer 66

Distributed Host-Based Architecture Reports are generated. Target Audit Subsystem Audit Command Console Forensics Report Detection Engine Local Response Alert Base Security Officer 67

Advantages and Disadvantages of the Centralized Architecture. Advantages Disadvantages No performance degradation on the target No real-time detection Statistical behavioral information No real-time response Multi-host signatures Some network traffic Raw data archive for prosecution support 68

Advantages and Disadvantages of a Distributed Real-Time Architecture. Advantages Disadvantages Real-time alerting Performance degradation on the target Real-time response No statistical behavioral information No multi-host signatures No raw data archive for prosecution support Reduced data forensics capabilities Gaps in data analysis when system offline 69

Deterrence Host-based systems are designed more to deter insiders, but can t effectively deter outsiders. Insiders fear that misuse will be detected through a host-based system but an outsider will know that host-based systems have little effect in detecting efforts to break in. 70

Deterrence The exact opposite is true for networkbased intrusion detection. An outsider is more likely to be deterred knowing that the computer may be identified, whereas the insider won t need to execute any of the transactions normally detected by network intrusion detection. 71

Real-Time Response Host-based systems provide poor real-time response but cannot effectively protect against one-time catastrophic events. They are, however excellent at detecting and responding to long-term attacks Such as thieving or disgruntled employees. 72

Real-Time Response The exact opposite is true for network intrusion detection. It is effective in real-time detection and response as it pertains to the network. Network intrusion detection can also be effective at detecting long-termattacks such as sniffer programs regularly reporting information from outside the firewall. 73

Determining the Extent of a Compromise Host-based systems stand out when it comes to determining the extent of a compromise after loss. They usually maintain large databases that indicate historical information that could serve as evidence in the prosecution of a misuser. 74

Determining the Extent of a Compromise Network intrusion detection can be used to trace a series of connections through a network. This could be helpful in finding the misuser whom the evidence from the hostbased system can be attributed to. 75

Trending Host-based systems maintain large databases of behavioral information that can be mined for trends indicative of misuse. An example could be identifying a user who is scanning for sensitive data. 76

Trending Network-based intrusion detection systems have similar capabilities, but the network environment limits the use of these capabilities. Network detection systems can be used for identifying problem IP addresses so as to have the firewall block those addresses in the future. 77

Prosecution Support Based on the integrity of the source data. Host-based systems can provide some level of integrity and provide the forensics tools to present the data in a valid format. 78

Prosecution Support Unfortunately, network data packets can t be trusted by their very nature. As a result of spoofing, such as spoofing IP addresses, network data is rendered invalid. 79

Comparing Network and Host-Based Benefits 80

Policies Policies are what drive the operation of an intrusion detection system. Effective policy can significantly reduce performance degradation and resource costs associated with operating a hostbased detection system Audit and detection policies are two primary policies that need to be managed effectively. 81

Audit Policy Audit policy defines which end user actions will result in an event record being written to an event log. Reducing the number of event log records collected can reduce the performance related issues with host-based systems, so an effective audit policy is crucial. 82

Audit Policy Audit policies are complex affairs involving multiple flags in numerous locations. The large majority of events are caused by system object accesses. To control the audit subsystem to a fine detail, audited events are restricted to access of mission critical files, folders, and objects only. 83

Audit Policy However, is it more important to track the people who fail to access the sensitive data, or the ones who are successfully accessing sensitive data. Capturing legitimate behaviors introduces the concept of positive and negative auditing. 84

Negative Audit Policy Traditional exception auditing This includes: Failed login attempts Failed file reads Failed file modifications 85

Positive Audit Policy Positive auditing is the process of logging both successful and failed events. This represents a reduction in the number of false positives. A specific example is keeping track of all users who access a certain directory. 86

Audit Policy Trade-Off Enabling event failures would indicate potential problem areas, while enabling full auditing would provide too much information for view and cause significant performance penalties. The net result is that exception auditing became the standard audit policy. 87

Effective Audit Policy The key to a successful intrusion detection system is an effective audit policy. An effective audit policy is one that provides a suitable number of event records. That is, not so much that they can t effectively be analyzed, and not so little that interesting behaviors are lost. 88

Signatures Host-based intrusion detection, like networkbased, has a detection engine that identifies patterns of misuse in the target data. Detection policy defines the patterns that are detected in the event log records. Signature recognition is the most common detection mechanism Signatures are pre-defined patterns that have been defined as suspicious by the security officer. 89

Signatures Fore example, a typical pattern being searched for is unauthorized modification to files in the directory that holds employee financial information. The key to a good detection policy is properly configured signatures, with the appropriate number of active signatures detected in real-time. 90

Signatures sources to which the signatures can be searched for originate from log files File logs Operating system logs Application logs Syslog Backup applications Firewalls 91

Statistical Analysis Host-based intrusion detection systems also analyze user statistics to determine misuse. This method is called statistical analysis. It can be used to identify trends in behavioral data and damage assessment. 92

Statistical Analysis Essentially, statistics are gathered from the history of the user s behavior and compared with their short-term behavior. When the difference is sufficiently large between the two, a warning flag is raised automatically. This method has the advantage of detecting misuse to which there are no signatures available as in newly developed exploits. 93

Neural Networks and Support Vector Machines Are being researched in universities, but have not made it to the market quite yet. 1 st phase consists of preprocessing, which uses automated parsers to process the randomly selected raw TCP/IP dump data into machine readable form. 94

Neural Networks and Support Vector Machines 2 nd phase consists of training SVMs on different types of attacks and normal data. The data have 41 input features and fall into two categories: normal or attack. The SVMs are trained with normal and intrusion data. Final phase involves measuring the performance on the testing data. 95

Neural Networks and Support Vector Machines In theory, SVMs are learning machines that plot the training vectors in high dimensional feature space, labeling each vector by class, either normal or attack. SVMs classify data by determining a set of support vectors, which are members of the set of training inputs that outline a hyper plane in feature space. 96

Automated Response Automated response can be used by attackers as an excellent denial of service mechanism to the network. Logging off users is used when a user has been positively identified as misusing the system. Not very effective, the user can just log back on. Becomes a denial of service when a good user is mistaken for a bad one. A good user can repeatedly be logged off and thus prevented from doing their job. 97

Automated Response Disabling an account is much more effective because the bad user is now unable to logon and is effectively barred from entrance into the system. This requires intervention from the administrator or the help desk which takes time. If a bad user abuses the account of a good user, then the good user is denied service until the issue is resolved. 98

Automated Response Shutting down the target is potentially one of the most severe of all automated responses. Denies service to all of its users and may take time to recover. Information loss may also result, depending on the types of applications running at the time of shutdown. 99

Automated Response Stopping the process, in theory, just shuts down the offending process, leaving all the good processes alone. Unfortunately, most of the target processes are good processes including sendmail. This method can successfully shutdown sniffers and password crackers. 100

Automated Response Breaking the network connection is used primarily by network intrusion detection systems when a villain connection has been discovered. The user need only re-establish the connection. 101

Automated Response Denying network requests is the network equivalent of disabling an account with the same internet risks. The attacker could spoof a legitimate user s IP address whose service would then be blocked. 102

Automated Response There are good candidates for automated real-time response. They are characterized by the following traits: The occurrence is rare. The event is catastrophic. The even can t be spoofed. The even is positively identifiable as misuse. 103

Behavioral Forensics Behavioral data forensics describes data mining techniques used in analyzing large intrusion detection databases. Behavioral data forensics is about analyzing behavior. It involves error detection and eradication by looking at historical events rather than static configuration information. Trending and damage assessment are two major benefits. 104

Behavioral Forensics Behavioral forensics has many uses such as: Detecting insiders misusing corporate computers by identifying trends of misuse and irregular activity. Detecting hackers attempting to attack corporate computers by identifying attack trends. 105

Behavioral Forensics More uses: Improving corporate policy by creating policies that better fit observed behavior rather than predict behavior. Misuse trends could be attributed to bad policies, or the lack there of. Distinguishing between process and automated problems by identifying root causes. Problems are sometimes the result of automated response. 106

Behavioral Forensics More uses of behavioral data forensics: Identifying areas of inefficiency. Most misuse, both internal and external, ultimately results in reduced organizational efficiency. Preventing minor issues from becoming large problems by identifying trends when the associated problems are still minor. For example, a server that is showing a trend toward processor failure can be replaced before it fails completely and stops the business. 107

Behavioral Forensics Behavioral data forensics is highly dependant on the target database and data sources. User-centric monitoring means the database is optimized to provide user data. Target-centric monitoring means the database is optimized to provide target data. 108

Behavioral Forensics For example: User-centric monitoring analyzes all the logins a specific user had across the entire enterprise. Target-centric monitoring analyzes all the logins to a specific set of targets. For database search times, target-centric monitoring is very efficient. Efficient because a search for a signature to all users on a single target will be very efficient and pulled from a single table. 109

Operational Modes Determining how to operate the system will significantly influence the overall effectiveness of deployment. Related to the number of man-hours required to operate the system. The fear is that resource costs will drive the total cost of ownership. 110

Operational Modes Background operations do not require human intervention. The goal is to reduce human intervention and labor-hours overall, because people s time costs money. Maximizing background operation will lower total cost of ownership. 111

Operational Modes On-demand operation is the lowest overhead operational mode. Essentially, the intrusion detection system does nothing unless it is told to. Can be used for on-demand monitoring and surveillance. Fewer risks than those associated with active components because there is no ongoing execution to cause operational problems. 112

Scheduled Operation Scheduled operation performs intrusion detection tasks at regularly scheduled intervals. For example performing a resource intensive operation at a time when resources are abundant, like at night. Another example is producing regularly scheduled reports like automatically generating an end of the week report that highlights all the security incidents. 113

Real-Time Operation Real-time operation, as it pertains to intrusion detection, usually implies on-going monitoring with detection and response in minutes or seconds. Real-time operation is a derivative of background operation. Implies an agent running on the target system that may have performance implications. Also implies automated response without human intervention and so has a significant inherent risk. 114

Summary Intrusion detection complements firewalls Host-based intrusion detection searches logs for pre-defined patterns of misuse. Network-based intrusion detection searches packets for pre-defined patterns of misuse. Effective audit policies and signatures are key to an effective intrusion detection system. Behavioral data forensics offers benefits in addition to intrusion detection which include system efficiency. 115

Where to Get More Information Books Proctor, Paul E. The Practical Intrusion Detection Handbook. New Jersey: Prentice Hall PTR, 2001. Hartmanis, J.; Goos, G.; van Leeuwen, J. Information Security Second International Workshop. Germany: Springer, 1999. Northcutt, Steven. Network Intrusion Detection, An Analyst s Handbook. Indianapolis: New Riders, 1999. 116

Where to Get More Information Papers Bace, Rebecca. An Introduction to Intrusion Detection and Assessment: for System and Network Security Management. ICSA White Paper, 1998. Mukkamala, Srinivas; Janoski, Guadalupe; Sung, Andrew. Intrusion Detection Using Neural Networks and Support Vector Machines. IEEE IJCNN May, 2002. ---. Intrusion Detection Using Support Vector Machines. 29 May 2003 < http://www.cs.nmt.edu/~it/papers/hpccsandiagofinal. pdf>. 117