Intelligent Analytics Assurance for Big Data Systems

Size: px
Start display at page:

Download "Intelligent Analytics Assurance for Big Data Systems"

Transcription

1 Assurance White Paper Intelligent Analytics Assurance for Big Data Systems A framework for real-time Big Data Testing

2 About the Authors Debasish Das With more than a decade in the IT industry, Debasish Das currently heads the Assurance Cluster Center of Excellence (CoE) for the Energy, Utilities and Media verticals. Debasish has been instrumental in setting up Global Test Labs and testing CoEs for many customers. He brings rich hands-on expertise in the areas of test automation and performance testing of enterprise systems including Big Data. Debasis Rout Debasis Rout has worked extensively for three years on complex testing projects and been instrumental in creating unique automation frameworks in the Assurance arena. An avid researcher, Debasis has successfully completed numerous proofs-of-concept using unique tools and techniques in Automation of Analytics and Big Data systems. Debasis is currently part of the Big Data Testing initiative within TCS' Assurance Services Unit. Padmalaya Pradhani Padmalaya Pradhani, who has been with TCS for the past six years, specializes in Java development for open-source ecommerce- and SOA-based applications. Padmalaya has also worked extensively as a Business Intelligence expert. She has patents filed in India and the US. Padmalaya currently works with the Cluster CoE team of the Assurance Services Unit (ASU) and leads the unit's Big Data Testing initiative for multiple customers.

3 Abstract Enterprises determined to retain their leadership positions in tomorrow's world are moving marketing analytics from the traditional to the Big Data paradigm. But Big Data systems that have poorly integrated business intelligence frameworks, weak data scrubbing rules or non-real-time data processing are unlikely to be fail-safe with cost prohibitive consequences. Big Data errors can also surface repeatedly unless Assurance teams implement foolproof data validation. This paper proposes an approach for Big Data frameworks that avoids pitfalls and delivers ROI on analytics, prevents technological obsolescence, minimizes legacy maintenance, and enables swift ramp-ups.

4 Contents Introduction 5 Why Do We Need Big Data Analytics? 5 The Pitfalls of Existing Big Data Solutions 6 Features of a Holistic Enterprise Assurance Framework 6 Conclusion 8

5 Introduction Credit card companies routinely maintain every byte of their customers' data, including the details of each card swipe. This is Big Data: 51 percent of it is structured, while 49 percent is unstructured or semi-structured.¹ It does not lend itself to traditional data analytics, which is effective only on structured data. The behavioral analytics such enterprises carry out on the data helps them understand their customers' spending and credit patterns and provide improved customer service. Thus, thanks to the power of Big Data analytics, you can expect to receive promotional offers of, say, tickets for an unreleased movie whose trailer you recently liked or shared on social media. Big Data has ushered in a veritable universe of data entropy. Big Data analytics enable marketers to draw intelligent inferences from analyses of digital data that often manifest little correlation to the untrained eye. Experts use Big Data analytics to directly translate information into insight, improving decision-making and business performance. Big Data analytics has significant, measurable positive business impact and benefits. Slip-ups in Big Data analytics can also happen - with expensive consequences. Consider the following example. One morning, a credit card company's client executive calls one of its customers to verify a recent card transaction - the purchase of a smart phone - which, according to the customer's prior spending behavior, is not a usual pattern. Nevertheless, the customer confirms her purchase, and all is well. The company's intelligence, powered by Big Data, helped to identify the unusual shopping pattern. However, the executive, also notices other recent transactions that do not seem to follow the customer's standard purchase history. A few minutes into the call and the customer is shocked to see that there were multiple gambling transactions made in Vegas several days before the smart phone purchase. So while Big Data helped to identify one unusual shopping pattern, it failed to notice another. It was a case of Big Data testing gone wrong. Why Do We Need Big Data Analytics? Handling Big Data volumes has been a key challenge, as multiple zetabytes of data, if not more, reside in today's digital universe. Enterprises have already invested heavily in business intelligence (BI) frameworks and are attempting to build Big Data solutions over them. But they are baffled by the increasing demand for faster data processing, essential for achieving meaningful analytics outcomes in developing such frameworks. However, computer scientists are making breakthroughs in high-speed, high-volume data processing. A leading search engine defines algorithms that help break search problems into sub-problems and distribute the corresponding computational workloads across thousands of nodes and process them further using SQL or SQLbased BI tools. However, their biggest challenge at this juncture is achieving real-time data processing that correlates data structures within the existing framework to provide meaningful analyses. Thus, while businesses agree that they must process high-volume transaction data-sets intelligently, they have numerous questions regarding how they should navigate that endless ocean. [1] Tata Consultancy Services, The Emerging Returns on Big Data: A TCS 2013 Global Trend Study, 2013, May 7, 2015, 5

6 The Pitfalls of Existing Big Data Solutions The three major challenge areas associated with testing Big Data solutions include: a) Seamless integration. Integration of an existing BI framework with Big Data components is a challenge because the search algorithm in use may not be in a format that data warehousing standards validate. This leaves the Big Data system running the major risk that the BI ecosystems concerned integrate poorly with the results the algorithm has processed. Consequently, testing professionals cannot assure overall system quality because the BI and Big Data systems remain operationally disparate although they are theoretically interdependent. b) Data standards and data clean-up. Big Data systems lack precise rules that govern the data standards for filtering out or scrubbing bad data. The data for Big Data analytics includes sources hitherto unheard of, including unconventional sources - devices like sensors, social media inputs such as tweets, etc. However, frameworks currently available in the market are not as agnostic as they should be to accommodate these data points for analysis. c) Real-time data processing. Big Data solutions also need accuracy in predicting high-density data volumes and making them BI-friendly. But Big Data environments lack compatible adapters that enable real-time data processing in clusters or nodes. However, the frameworks that enable Big Data-set processing in smaller clusters or nodes do so in batches and not in the real-time mode. Features of a Holistic Enterprise Assurance Framework Given these challenges adopting an appropriate quality assurance (QA) strategy ensures that the Big Data system's customer behavioral analysis-based predictions are valid. This, in turn, demands that a holistic QA strategy become a quintessential aspect of the total solution. The following seven features should be considered for an ideal end-to-end Big Data Assurance Framework (Fig.1), as described below: Data validation Field-to-field map testing Initial data processing Job profiling validation 6 5 Distributed file system validation 4 3 Data processing speed testing Processing logic validation Fig. 1: A Proposed Big Data Assurance Framework 6

7 1) Data validation. Big Data enterprise ecosystems should have the capability to read data from any source, of any size, and at any speed. The framework must validate the data drawn from a wide, unconstrained range of sources - structured data such as spreadsheets, text files and unstructured data in the form of audio, image or video, as well as the Web, and GIS; among others. For instance, the utilities industry generates data through wattmeters and thermostats. This data is unlike that which computers or mobile phones generate; it creates a universe of data from different sources. Both the data and the devices vary. Thus, the data does not conform to the data standards that apply to traditional data sources. 2) Initial data processing. Big Data systems can process data in chunks and store it in nodes. The framework should therefore validate the initial unstructured-data processing stage and use an appropriate processing script, since the processed chunk of large data clusters is stored in nodes and used for data analysis and communication. In contrast to traditional data warehousing systems (which batch-process data and manifest latency in reflecting the latest processed data), the proposed framework would help analyze real-time data clusters. 3) Processing logic validation. The processing logic defined in the query language should be able to tidy up and organize the mammoth unstructured data into clusters. The enterprise data warehouse (EDW) should then input and validate the resulting data, using the traditional Extract-Transform-Load testing approach and the business logic of the key performance indicators used in report analysis, respectively. The framework must validate the incoming records with the outgoing data, inspecting both the number and hygiene of records transferred. This aspect becomes crucial, especially in banking transactions, where every single transaction can yield data that, if ignored, can lead to disastrous results. Hence, it is imperative to keep count of incoming and processed records so that one may establish the integrity of data and prevent data loss. 4) Data processing speed testing. To automate testing and identify bad data, the Big Data Assurance framework should integrate seamlessly with tools like ETL Validator and QuerySurge, among others. Such tools validate data from source files and other databases, compare it with the target data, and swiftly generate reports after analysis, pinpointing differences, if any. It should enable high-speed bulk data processing because speed is crucial in realtime digital data analysis. Several open-source tools exist that integrate well with Big Data frameworks for realtime performance monitoring of nodes and clusters are available, e.g. Munin and Nagios. For example, in the oil and gas industry, to optimize operations and avoid hazardous incidents, real-time oil well health monitoring is critical. Therefore, sensors continuously collect data on hundreds of well attributes - viscosity, pressure, temperature, and contamination levels, to name a few - and seismic information on each well which is fed to control stations for real-time processing. Consequently, in such scenarios, the speed of testing is vital in assuring the smooth operation and safety compliance of the wells. Thus, any delay in raising alarms that the real-time well health data processing triggers could have catastrophic results. 5) Distributed file system validation. For Big Data-based frameworks, which process data in distributed clusters, validation is key. Moreover, because the failure of a single node in a cluster prevents full functional testing, performance testing is imperative in such frameworks: it enables setting benchmarks for data that a cluster environment supports. This validation feature can help the Big Data Assurance framework to determine data flow parameters such as velocity, volume of data processed per node, and variety of data amalgamated in each node. 7

8 6) Job profiling validation. Job profiling in Big Data frameworks is essential prior to processing unstructured data algorithms because missing out on even one algorithm may cause massive adverse business impact. Therefore, the framework must allow the use of open-source tools like Jumbune and others, which leverage optimization through fine-grained node level analytic capability (to identify bottlenecks) and cluster-level resource consumption dashboards. For instance, the size of MapReduce jobs is too large for Hadoop processing. Moreover, errors in MapReduce algorithms raise the chances for job failure. Hence, the memory consumed by a Hadoop system may be higher, which can result in destabilizing the Hadoop cluster. Therefore, validating the MapReduce algorithm first on a small data chunk - job profiling - becomes imperative. 7) Field-to-field map testing. Migrating from legacy to Big Data databases involves massive architectural makeovers. These include solution-specific integration testing of which validating field-to-field mapping and schemas is an ideal part. Done well, such mapping ensures nil or minimal impact to critical data during migration. Conclusion For businesses to take full advantage of the potential of Big Data, formulating an effective validation strategy is key. The success of a business is directly proportional to the effectiveness with which an independent testing team can validate structured and unstructured data of large volume, wide variety and high velocity. The assurance framework we propose will help organizations predict ROI on their Big Data analytics. Securing their investments in this manner will enable enterprises to stay up to date on their Big Data architecture, while maintaining their traditional information architecture. The solution not only helps organizations build a validation framework over their existing data warehouse but also empowers them to ramp up and adopt new Big Data approaches for faster real-time - and, thus, more meaningful - data analysis. 8

9 About TCS' Assurance Services Unit With one of the most comprehensive portfolios of independent test capabilities on offer, TCS addresses both business and quality challenges for its global clients. We empower organizations across domains to optimize overheads, realize first mover advantage and improve customer satisfaction. TCS offers assurance services across the testing value cycle, including test consulting and advisory, test services implementation, and managed services for test environment and test data management. We continually redefine testing and QA paradigms to help our clients stay ahead of the curve. Our library of domain-based reusable business functions and proven engagement model founded on the twin pillars of product and process quality enable us to deliver certainty to our clients. Over 28,000 testing consultants, strategic alliances and partnerships with key product vendors, more than 60 dedicated test centers of excellence and our innovation labs power our tailor-made solutions, testing assets and accelerators. With specialized test environments and labs, TCS drives the delivery of assurance in a non-disruptive, agile, and automated manner, making the entire development lifecycle more efficient. Contact For more information about TCS Assurance Services Unit, visit: Blog: #ThinkAssurance About Tata Consultancy Services (TCS) Tata Consultancy Services is an IT services, consulting and business solutions organization that delivers real results to global business, ensuring a level of certainty no other firm can match. TCS offers a consulting-led, integrated portfolio of IT and IT-enabled infrastructure, engineering and TM assurance services. This is delivered through its unique Global Network Delivery Model, recognized as the benchmark of excellence in software development. A part of the Tata Group, India s largest industrial conglomerate, TCS has a global footprint and is listed on the National Stock Exchange and Bombay Stock Exchange in India. For more information, visit us at IT Services Business Solutions Consulting All content / information present here is the exclusive property of Tata Consultancy Services Limited (TCS). The content / information contained here is correct at the time of publishing. No material from here may be copied, modified, reproduced, republished, uploaded, transmitted, posted or distributed in any form without prior written permission from TCS. Unauthorized use of the content / information appearing here may violate copyright, trademark and other applicable laws, and could result in criminal or civil penalties. Copyright 2015 Tata Consultancy Services Limited TCS Design Services I M I 06 I 15

Transportation Solutions Built on Oracle Transportation Management. Enterprise Solutions

Transportation Solutions Built on Oracle Transportation Management. Enterprise Solutions Transportation Solutions Built on Oracle Transportation Management Enterprise Solutions Optimizing transportation operations and ensuring improved customer service Today s complex and challenging business

More information

Business Process Services. White Paper. Automating Email Management: Managing Workflow Effectively

Business Process Services. White Paper. Automating Email Management: Managing Workflow Effectively Business Process Services White Paper Automating Email Management: Managing Workflow Effectively About the Authors Deva Latha S. Assistant Consultant Deva Latha has over nine years of experience in Business

More information

Robotic Process Automation: Reenergizing the Directory Publishing Industry

Robotic Process Automation: Reenergizing the Directory Publishing Industry A Point of View Robotic Process Automation: Reenergizing the Directory Publishing Industry Abstract Evolving digital marketing avenues including video, SEM/SEO, mobile, and social media are fast replacing

More information

Business Process Services. White Paper. Improving Efficiency in Business Process Services through User Interface Re-engineering

Business Process Services. White Paper. Improving Efficiency in Business Process Services through User Interface Re-engineering Business Process Services White Paper Improving Efficiency in Business Process Services through User Interface Re-engineering About the Authors Mahesh Kshirsagar Mahesh has a vast experience of about 24

More information

Business Process Services. White Paper. Business Intelligence in Finance & Accounting: Foundation for an Agile Enterprise

Business Process Services. White Paper. Business Intelligence in Finance & Accounting: Foundation for an Agile Enterprise Business Process Services White Paper Business Intelligence in Finance & Accounting: Foundation for an Agile Enterprise About the Author Balaji Venkat Chellam Iyer Balaji has over 18 years of experience

More information

HiTech. White Paper. A Next Generation Search System for Today's Digital Enterprises

HiTech. White Paper. A Next Generation Search System for Today's Digital Enterprises HiTech White Paper A Next Generation Search System for Today's Digital Enterprises About the Author Ajay Parashar Ajay Parashar is a Solution Architect with the HiTech business unit at Tata Consultancy

More information

Digital Enterprise Unit. White Paper. Reimagining the Future of Field Service Management with Digital Technologies

Digital Enterprise Unit. White Paper. Reimagining the Future of Field Service Management with Digital Technologies Digital Enterprise Unit White Paper Reimagining the Future of Field Service Management with Digital Technologies About the Author Rahul Trisal Rahul is a senior Digital Strategy Consultant with TCS' Digital

More information

Lead the Retail Revolution.

Lead the Retail Revolution. Lead the Retail Revolution. The retail industry is at the center of a dramatic shift in the way consumers shop and interact with their retailers. After hundreds of years of customers going to the store,

More information

Business Process Services. White Paper. Configurable, Automated Workflows: Transforming Process Effectiveness for Business Excellence

Business Process Services. White Paper. Configurable, Automated Workflows: Transforming Process Effectiveness for Business Excellence Business Process Services White Paper Configurable, Automated Workflows: Transforming Process Effectiveness for Business Excellence About the Authors Ohm Kumar Ohm Kumar is a Business Analyst with the

More information

Digital Enterprise. White Paper. Multi-Channel Strategies that Deliver Results with the Right Marketing Attribution Model

Digital Enterprise. White Paper. Multi-Channel Strategies that Deliver Results with the Right Marketing Attribution Model Digital Enterprise White Paper Multi-Channel Strategies that Deliver Results with the Right Marketing Model About the Authors Vishal Machewad Head Marketing Services Practice Vishal Machewad has over 13

More information

Business Process Services. White Paper. Optimizing Extended Warranty Processes by Embracing Analytics

Business Process Services. White Paper. Optimizing Extended Warranty Processes by Embracing Analytics Business Process Services White Paper Optimizing Extended Warranty Processes by Embracing Analytics About the Author Dr. Anuj Prakash Anuj Prakash is a part of the TCS Analytics and Insights Practice,

More information

Linking Transformational Initiatives to Desired Business Outcomes: Leveraging a Business-Metrics Driven Framework

Linking Transformational Initiatives to Desired Business Outcomes: Leveraging a Business-Metrics Driven Framework Business Process Services White Paper Linking Transformational Initiatives to Desired Business Outcomes: Leveraging a Business-Metrics Driven Framework About the Author Venkatesh Kuppuswamy Venkatesh Kuppuswamy

More information

KYCS - Integrating KYC with Social Identity: The Future-Ready Marketing Approach

KYCS - Integrating KYC with Social Identity: The Future-Ready Marketing Approach A Point of View KYCS - Integrating KYC with Identity: The Future-Ready Marketing Approach Abstract media has empowered us to voice and share our opinion on things that impact our lives. It has reshaped

More information

ion IT-as-a-Service Solution

ion IT-as-a-Service Solution ion IT-as-a-Service Solution "The ion Manufacturing Solution enabled us to control our business more meaningfully, including our field operations. Through the Field Force module, we have updated information

More information

Next Generation Electric Utilities Gear up Using Cloud Based Services

Next Generation Electric Utilities Gear up Using Cloud Based Services A Point of View Next Generation Electric Utilities Gear up Using Cloud Based Services Abstract Globally, liberalization of the electricity sector has driven a paradigm shift in the ownership structure,

More information

The four windows of organizational change in training for ERP transformation

The four windows of organizational change in training for ERP transformation White Paper The four windows of organizational change in training for ERP transformation Managing users apprehension to change has always been a challenge for large scale ERP implementations. Moving the

More information

Over 18,400 branches. 21,843 ATMs. 261 million accounts. Enabling State Bank of India to create the world s largest homogenous banking network

Over 18,400 branches. 21,843 ATMs. 261 million accounts. Enabling State Bank of India to create the world s largest homogenous banking network Wealth Management Volatility and uncertainty in the markets have given rise to a new class of customers who are extremely cautious and demand absolute transparency from their advisors. They now expect

More information

Business Process Services. White Paper. Leveraging the Internet of Things and Analytics for Smart Energy Management

Business Process Services. White Paper. Leveraging the Internet of Things and Analytics for Smart Energy Management Business Process Services White Paper Leveraging the Internet of Things and Analytics for Smart Energy Management About the Author Akhil Bhardwaj Akhil Bhardwaj is a Senior Manager in the Analytics and

More information

Business Process Services. White Paper. Mitigating Trade Fraud: The Case for Detecting Group Level Fraudulent Activity

Business Process Services. White Paper. Mitigating Trade Fraud: The Case for Detecting Group Level Fraudulent Activity Business Process Services White Paper Mitigating Trade Fraud: The Case for Detecting Group Level Fraudulent Activity About the Author Narasimha Murty M V Narasimha Murty holds a Master's degree in Mathematics

More information

Business Process Services. White Paper. Effective Credit Risk Assessment Strengthening the Financial Spreading with Technology Enablers

Business Process Services. White Paper. Effective Credit Risk Assessment Strengthening the Financial Spreading with Technology Enablers Business Process Services White Paper Effective Credit Risk Assessment Strengthening the Financial Spreading with Technology Enablers About the Author Vijay Muppavarapu Vijay is a subject matter expert

More information

Business Process Services. White Paper. Social Media Influence: Looking Beyond Activities and Followers

Business Process Services. White Paper. Social Media Influence: Looking Beyond Activities and Followers Business Process Services White Paper Social Media Influence: Looking Beyond Activities and Followers About the Author Vandita Bansal Vandita Bansal is a subject matter expert in Analytics and Insights

More information

BI Today and Tomorrow

BI Today and Tomorrow White Paper BI Today and Tomorrow BI has been one of the most important business initiatives providing positive impact on the health of organizations. Usually, questions are raised on the maturity of the

More information

Business Process Services. White Paper. Improving Agility in Accounts Receivables with Statistical Prediction and Modeling

Business Process Services. White Paper. Improving Agility in Accounts Receivables with Statistical Prediction and Modeling Business Process Services White Paper Improving Agility in Accounts Receivables with Statistical Prediction and Modeling About the Authors R Rengesh Siva Rengesh Siva has over 14 years of experience in

More information

Backward Scheduling An effective way of scheduling Warehouse activities

Backward Scheduling An effective way of scheduling Warehouse activities Backward Scheduling An effective way of scheduling Warehouse activities Traditionally, scheduling algorithms were used in capital intensive production processes where there was a need to optimize the production

More information

The 4 Pillars of Technosoft s Big Data Practice

The 4 Pillars of Technosoft s Big Data Practice beyond possible Big Use End-user applications Big Analytics Visualisation tools Big Analytical tools Big management systems The 4 Pillars of Technosoft s Big Practice Overview Businesses have long managed

More information

Redefining Agile to Realize Continuous Business Value

Redefining Agile to Realize Continuous Business Value A Point of View Redefining Agile to Realize Continuous Business Value Abstract As enterprises look to move the needle on their business in an intensely competitive market, they expect superior performance

More information

Business Process Services. White Paper. Price Elasticity using Distributed Computing for Big Data

Business Process Services. White Paper. Price Elasticity using Distributed Computing for Big Data Business Process Services White Paper Price Elasticity using Distributed Computing for Big Data About the Authors Rajesh Kavadiki Rajesh is part of the Analytics and Insights team at Tata Consultancy Services

More information

Powering Cutting Edge Research in Life Sciences with High Performance Computing

Powering Cutting Edge Research in Life Sciences with High Performance Computing A Point of View Powering Cutting Edge Research in Life Sciences with High Performance Computing High performance computing (HPC) is the foundation of pioneering research in life sciences. HPC plays a vital

More information

Business Partner of. Hardware + Network + Software + Services

Business Partner of. Hardware + Network + Software + Services Business Partner of Hardware + Network + Software + Services About RDS Business Services RDS Business Services do services like Web Services, Software Services, Software Testing, Contract Staffing, Placement

More information

ion Human Capital Management Solution

ion Human Capital Management Solution ion Human Capital Solution For organizations spread across multiple sites, Human Resource processes such as recruitment, deputation, and employee appraisal are complex. HR departments are increasingly

More information

Oracle Data Integrator 12c (ODI12c) - Powering Big Data and Real-Time Business Analytics. An Oracle White Paper October 2013

Oracle Data Integrator 12c (ODI12c) - Powering Big Data and Real-Time Business Analytics. An Oracle White Paper October 2013 An Oracle White Paper October 2013 Oracle Data Integrator 12c (ODI12c) - Powering Big Data and Real-Time Business Analytics Introduction: The value of analytics is so widely recognized today that all mid

More information

Big Data for Data Warehousing

Big Data for Data Warehousing A Point of View Big Data for Data Warehousing Introduction A Data Warehouse (DW) is a central repository of information created by integrating data from multiple disparate sources. DWs store current as

More information

Overview. Integrated Front-mid-back office as well as standalone Front office or Back-office solution or Trading Channels

Overview. Integrated Front-mid-back office as well as standalone Front office or Back-office solution or Trading Channels Securities Trading The adoption of technology is rapidly changing the dynamics of the brokerage industry. The increasing use of smartphones and tablets represent a transformation in the way in which investors

More information

Business Process Services. White Paper. Predictive Analytics in HR: A Primer

Business Process Services. White Paper. Predictive Analytics in HR: A Primer Business Process Services White Paper Predictive Analytics in HR: A Primer About the Authors Tuhin Subhra Dey Tuhin is a member of the Analytics and Insights team at Tata Consultancy Services (TCS), where

More information

Retail. White Paper. Driving Strategic Sourcing Effectively with Supply Market Intelligence

Retail. White Paper. Driving Strategic Sourcing Effectively with Supply Market Intelligence Retail White Paper Driving Strategic Sourcing Effectively with Supply Market Intelligence About the Author Devaraj Chithur Devaraj is part of the Supply Chain group within Tata Consultancy Services (TCS)

More information

Business Process Services. White Paper. Managing Customer Experience: Strategies for Success

Business Process Services. White Paper. Managing Customer Experience: Strategies for Success Business Process Services White Paper Managing Customer Experience: Strategies for Success About the Author Ashwin Fernandes, Assistant Manager, TCS Ashwin is a practice consultant in the Innovation and

More information

A pay-as-you-use model About TCS ion Integrated solutions Personalized solutions www.tcsion.com Automatic upgrades Increased agility

A pay-as-you-use model About TCS ion Integrated solutions Personalized solutions www.tcsion.com Automatic upgrades Increased agility ion Payroll Solution As organizations strive to improve employee morale, job satisfaction, and productivity, it becomes imperative to regularize the payroll cycles, in order to keep employees motivated.

More information

Enter an insurance solution, TCS BaNCS from Tata Consultancy Services.

Enter an insurance solution, TCS BaNCS from Tata Consultancy Services. Insurance The financial crisis of 2008 and the subsequent recovery process, though tepid, has altered the insurance industry landscape significantly. Today, the focus is on enhancing efficiencies and controlling

More information

White Paper. Social Analytics

White Paper. Social Analytics White Paper Social Analytics This paper brings to forefront the growing popularity of social media as a source of data for analytics with relation to the telecom industry. The paper further elaborates

More information

Conferencing Agent Enhancing the Communication Experience

Conferencing Agent Enhancing the Communication Experience White Paper Conferencing Agent Enhancing the Communication Experience To achieve corporate operational excellence, the existing resources of an organization must be utilized to the best possible extent.

More information

Omni-Channel Banking Customer Experience: Forget What You Thought You Knew about Channels

Omni-Channel Banking Customer Experience: Forget What You Thought You Knew about Channels A Point of View Omni-Channel Banking Customer Experience: Forget What You Thought You Knew about Channels In social media, customers discuss their experience across ALL your interaction channels, which

More information

HiTech. White Paper. Storage-as-a-Service. SAN and NAS Reference Architectures leveraging Private Cloud Storage

HiTech. White Paper. Storage-as-a-Service. SAN and NAS Reference Architectures leveraging Private Cloud Storage HiTech White Paper -as-a-service SAN and NAS Reference Architectures leveraging Private Cloud About the Author Ankur Srivastava Ankur Srivastava is a Solution Architect working with the Hi Tech Industry

More information

ion Customer Relationship Management (CRM) Solution

ion Customer Relationship Management (CRM) Solution ion Customer Relationship Management (CRM) Solution How do you command the loyalty of your customers in a competitive market? How do you achieve an increase in sales? To help you answer these questions,

More information

Seven Strategic Imperatives for Transitioning to a Shared Services Model

Seven Strategic Imperatives for Transitioning to a Shared Services Model A Point of View Seven Strategic Imperatives for Transitioning to a Shared Services Model Abstract Given today s tough business climate, organizations are adopting a shared services model to realize cost

More information

Enterprise-wide Anti-money Laundering and KYC Initiatives A point of view

Enterprise-wide Anti-money Laundering and KYC Initiatives A point of view Enterprise-wide Anti-money Laundering and KYC Initiatives A point of view Introduction Every financial institution is charged with the responsibility of developing policies and procedures to combat money

More information

TCS Supply Chain Center of Excellence

TCS Supply Chain Center of Excellence TCS Supply Chain Center of Excellence Delivering Supply Chain Performance in Complex Dynamic Markets Supply Chain Management Supply Chain Management (SCM) has evolved and the focus has now shifted from

More information

Digital Enterprise. White Paper. Capturing the Voice of the Employee: Enterprise Social Media Monitoring and Analytics

Digital Enterprise. White Paper. Capturing the Voice of the Employee: Enterprise Social Media Monitoring and Analytics Digital Enterprise White Paper Capturing the Voice of the Employee: Enterprise Social Media Monitoring and Analytics About the Authors Praveen Mishra Praveen Mishra is a Business Development Lead with

More information

Implement Business Process Management to realize Cost Savings and High Return on Investments

Implement Business Process Management to realize Cost Savings and High Return on Investments Implement Business Process Management to realize Cost Savings and High Return on Investments Business Process Management (BPM) was unheard of just a few years ago, but it has burst onto the global scene

More information

Driving Airline Revenues and Profitability by Delivering Great Customer Experiences

Driving Airline Revenues and Profitability by Delivering Great Customer Experiences A Point of View Driving Airline Revenues and Profitability by Delivering Great Customer Experiences Two New Studies Point to the Direction Airlines are Taking with Their Customer Experience (CX) Initiatives.

More information

TCS Research Fellowship Program. Frequently Asked Questions by Researchers

TCS Research Fellowship Program. Frequently Asked Questions by Researchers TCS Research Fellowship Program Frequently Asked Questions by Researchers July 2010 Q1) What is the Aim of the scheme? The scheme is primarily aimed to help enhance our nation s talent base in doing research

More information

Bring Your Own Device (BYOD) A point of view

Bring Your Own Device (BYOD) A point of view Bring Your Own Device (BYOD) A point of view BYOD - Consumer driven IT Today, consumers possess powerful devices for their personal needs. Often, the computing power and features of the devices bought

More information

Business Process Services. White Paper. Personalizing E-Commerce: Improving Interactivity to Increase Revenues

Business Process Services. White Paper. Personalizing E-Commerce: Improving Interactivity to Increase Revenues Business Process Services White Paper Personalizing E-Commerce: Improving Interactivity to Increase Revenues About the Author Subramaniam MV Subramaniam is a Delivery Manager at Tata Consultancy Services

More information

Business Process Services. White Paper. Improving Regulatory Compliance in the Mortgage Industry

Business Process Services. White Paper. Improving Regulatory Compliance in the Mortgage Industry Business Process Services White Paper Improving Regulatory Compliance in the Mortgage Industry About the Author Lovette Patrick D'Souza Lovette Patrick D'Souza has over 10 years of experience in Banking

More information

Backlog Management Index (BMI) Evaluation and Improvement An ITIL Approach

Backlog Management Index (BMI) Evaluation and Improvement An ITIL Approach Backlog Management Index (BMI) Evaluation and Improvement An ITIL Approach Backlog Management Index is one of the important metrics that is closely monitored in Steady State of Maintenance and Support

More information

Business Process Transformation A Pulse Check

Business Process Transformation A Pulse Check White Paper Business Process Transformation A Pulse Check Over the last decade or two, two trends have been noticeable across all businesses. The move towards consolidation of office-based operations,

More information

IT Infrastructure Services. White Paper. Cyber Risk Mitigation for Smart Cities

IT Infrastructure Services. White Paper. Cyber Risk Mitigation for Smart Cities IT Infrastructure Services White Paper Cyber Risk Mitigation for Smart Cities About the Author Abhik Chaudhuri Abhik Chaudhuri is a Domain Consultant with the Information Technology Infrastructure Services

More information

Bridging the IT Business Gap The Role of an Enterprise Architect

Bridging the IT Business Gap The Role of an Enterprise Architect Whitepaper Bridging the IT Business Gap The Role of an Enterprise Architect Today s enterprises understand the value that Information Technology (IT) can bring to their business. IT supports day-to-day

More information

Life Sciences. White Paper. Integrated Digital Marketing: The Key To Understanding Your Customer

Life Sciences. White Paper. Integrated Digital Marketing: The Key To Understanding Your Customer Life Sciences White Paper Integrated Digital Marketing: The Key To Understanding Your Customer About the Authors Raghunandan H Head, Life Sciences Sales & Marketing Center of Excellence Raghunandan (Raghu)

More information

IBM Tivoli Netcool network management solutions for enterprise

IBM Tivoli Netcool network management solutions for enterprise IBM Netcool network management solutions for enterprise The big picture view that focuses on optimizing complex enterprise environments Highlights Enhance network functions in support of business goals

More information

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the

More information

Overview. Société Générale

Overview. Société Générale Payments Ever-changing market dynamics, customer expectations, rapidly evolving regulatory measures, ageing technology, consolidation in corporate treasury, advent of electronic instruments, increased

More information

BIG DATA THE NEW OPPORTUNITY

BIG DATA THE NEW OPPORTUNITY Feature Biswajit Mohapatra is an IBM Certified Consultant and a global integrated delivery leader for IBM s AMS business application modernization (BAM) practice. He is IBM India s competency head for

More information

Global Consulting Practice. White Paper. Mainframes: Bridging Legacy Systems. Building Digital Futures.

Global Consulting Practice. White Paper. Mainframes: Bridging Legacy Systems. Building Digital Futures. Global Consulting Practice White Paper Mainframes: Bridging Legacy Systems. Building Digital Futures. About the Author K Vaidyanathan K Vaidyanathan is a senior consultant with the Global Consulting Practice

More information

Securities Processing

Securities Processing Securities Processing Several challenges in the global securities market including new regulations, the pressure to reduce cost and minimize risk along with the mounting need for transparency, are forcing

More information

Oracle E-Business Suite (EBS) in the World of Oracle Exadata Engineered Systems

Oracle E-Business Suite (EBS) in the World of Oracle Exadata Engineered Systems A Point of View Oracle E-Business Suite (EBS) in the World of Oracle Exadata Engineered Systems As a proof-of-concept to evaluate the benefits of moving the Oracle E-Business Suite (EBS) database tier

More information

BPM Perspectives Positioning and Fitment drivers

BPM Perspectives Positioning and Fitment drivers BPM Perspectives Positioning and Fitment drivers BPM is a commonly used and much hyped acronym. It popularly stands for Business Process Management but now it achieves much more than just that. Especially

More information

EMC DOCUMENTUM MANAGING DISTRIBUTED ACCESS

EMC DOCUMENTUM MANAGING DISTRIBUTED ACCESS EMC DOCUMENTUM MANAGING DISTRIBUTED ACCESS This white paper describes the various distributed architectures supported by EMC Documentum and the relative merits and demerits of each model. It can be used

More information

Using In-Memory Computing to Simplify Big Data Analytics

Using In-Memory Computing to Simplify Big Data Analytics SCALEOUT SOFTWARE Using In-Memory Computing to Simplify Big Data Analytics by Dr. William Bain, ScaleOut Software, Inc. 2012 ScaleOut Software, Inc. 12/27/2012 T he big data revolution is upon us, fed

More information

Data Virtualization A Potential Antidote for Big Data Growing Pains

Data Virtualization A Potential Antidote for Big Data Growing Pains perspective Data Virtualization A Potential Antidote for Big Data Growing Pains Atul Shrivastava Abstract Enterprises are already facing challenges around data consolidation, heterogeneity, quality, and

More information

Dodd Frank Act: Partner your way to Compliance

Dodd Frank Act: Partner your way to Compliance A Point of View Dodd Frank Act: Partner your way to Compliance With the passage of the Dodd Frank Act, banks and financial institutions are grappling with a highly restrictive environment and burgeoning

More information

Life Sciences. White Paper. Real-time Patient Health Monitoring with Connected Health Solutions

Life Sciences. White Paper. Real-time Patient Health Monitoring with Connected Health Solutions Life Sciences White Paper Real-time Patient Health Monitoring with Connected Health Solutions About the Authors Ashok Khanna Global Head, Presales and Solutions, Engineering Industrial Services, Life Sciences

More information

A Whole New World. Big Data Technologies Big Discovery Big Insights Endless Possibilities

A Whole New World. Big Data Technologies Big Discovery Big Insights Endless Possibilities A Whole New World Big Data Technologies Big Discovery Big Insights Endless Possibilities Dr. Phil Shelley Query Execution Time Why Big Data Technology? Days EDW Hours Hadoop Minutes Presto Seconds Milliseconds

More information

Testing Big data is one of the biggest

Testing Big data is one of the biggest Infosys Labs Briefings VOL 11 NO 1 2013 Big Data: Testing Approach to Overcome Quality Challenges By Mahesh Gudipati, Shanthi Rao, Naju D. Mohan and Naveen Kumar Gajja Validate data quality by employing

More information

Simplify your admission process - The ion Way

Simplify your admission process - The ion Way Simplify your admission process - The ion Way Coordination from TCS employees has helped us lot in implementation of all modules of the ERP. It was helpful to have a person that managed to implement our

More information

Business Process Services. White Paper. Five Principles to Consider when Consolidating your Finance and Accounting Function

Business Process Services. White Paper. Five Principles to Consider when Consolidating your Finance and Accounting Function Business Process Services White Paper Five Principles to Consider when Consolidating your Finance and Accounting Function About the Authors Vikas Golchha, Associate Vice President, TCS Vikas is part of

More information

A Next-Generation Analytics Ecosystem for Big Data. Colin White, BI Research September 2012 Sponsored by ParAccel

A Next-Generation Analytics Ecosystem for Big Data. Colin White, BI Research September 2012 Sponsored by ParAccel A Next-Generation Analytics Ecosystem for Big Data Colin White, BI Research September 2012 Sponsored by ParAccel BIG DATA IS BIG NEWS The value of big data lies in the business analytics that can be generated

More information

Banking & Financial Services. White Paper. Automated Advice Delivery Platforms: Simplifying the Investment Management Game

Banking & Financial Services. White Paper. Automated Advice Delivery Platforms: Simplifying the Investment Management Game Banking & Financial Services White Paper Automated Advice Delivery Platforms: Simplifying the Investment Management Game About the Authors Srinivasa Kumar Yerchuru Srinivasa Kumar Yerchuru heads the Capital

More information

Driving Airline Revenues and Profitability by Delivering Great Customer Experiences

Driving Airline Revenues and Profitability by Delivering Great Customer Experiences A Point of View Driving Airline Revenues and Profitability by Delivering Great Customer Experiences Two New Studies Point to the Direction Airlines are Taking with Their Customer Experience (CX) Initiatives.

More information

Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep. Neil Raden Hired Brains Research, LLC

Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep. Neil Raden Hired Brains Research, LLC Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep Neil Raden Hired Brains Research, LLC Traditionally, the job of gathering and integrating data for analytics fell on data warehouses.

More information

ion Manufacturing Solution

ion Manufacturing Solution ion Manufacturing Solution Today with ion, while I am driving home I get to see all the information that I need, even when I am in a customer place I can take decisions looking at the information that

More information

EMC ADVERTISING ANALYTICS SERVICE FOR MEDIA & ENTERTAINMENT

EMC ADVERTISING ANALYTICS SERVICE FOR MEDIA & ENTERTAINMENT EMC ADVERTISING ANALYTICS SERVICE FOR MEDIA & ENTERTAINMENT Leveraging analytics for actionable insight ESSENTIALS Put your Big Data to work for you Pick the best-fit, priority business opportunity and

More information

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON 2 The V of Big Data Velocity means both how fast data is being produced and how fast the data must be processed to meet demand. Gartner The emergence

More information

The new A and B of the Finance Function: Analytics and Big Data

The new A and B of the Finance Function: Analytics and Big Data White Paper The new A and B of the Finance Function: Analytics and Big Data - Evolution of the finance function from bean counter to business partner There s no escaping the fact that finance, and the

More information

Business Process Services. White Paper. Strengthening Business Operations with the Digital Five Forces

Business Process Services. White Paper. Strengthening Business Operations with the Digital Five Forces Business Process Services White Paper Strengthening Business Operations with the Digital Five Forces About the Author Mahesh Kshirsagar Mahesh Kshirsagar heads Technology Transformation in the Business

More information

Business Process Services. White Paper. Redesigning Retail Operations: A Digitally Connected Supply Chain for Accelerated Performance

Business Process Services. White Paper. Redesigning Retail Operations: A Digitally Connected Supply Chain for Accelerated Performance Business Process Services White Paper Redesigning Retail Operations: A Digitally Connected Supply Chain for Accelerated Performance About the Author Swecha Rikhy Swecha Rikhy is a part of the Retail domain

More information

BIG DATA: FIVE TACTICS TO MODERNIZE YOUR DATA WAREHOUSE

BIG DATA: FIVE TACTICS TO MODERNIZE YOUR DATA WAREHOUSE BIG DATA: FIVE TACTICS TO MODERNIZE YOUR DATA WAREHOUSE Current technology for Big Data allows organizations to dramatically improve return on investment (ROI) from their existing data warehouse environment.

More information

Master big data to optimize the oil and gas lifecycle

Master big data to optimize the oil and gas lifecycle Viewpoint paper Master big data to optimize the oil and gas lifecycle Information management and analytics (IM&A) helps move decisions from reactive to predictive Table of contents 4 Getting a handle on

More information

Fast, Low-Overhead Encryption for Apache Hadoop*

Fast, Low-Overhead Encryption for Apache Hadoop* Fast, Low-Overhead Encryption for Apache Hadoop* Solution Brief Intel Xeon Processors Intel Advanced Encryption Standard New Instructions (Intel AES-NI) The Intel Distribution for Apache Hadoop* software

More information

High-Performance Business Analytics: SAS and IBM Netezza Data Warehouse Appliances

High-Performance Business Analytics: SAS and IBM Netezza Data Warehouse Appliances High-Performance Business Analytics: SAS and IBM Netezza Data Warehouse Appliances Highlights IBM Netezza and SAS together provide appliances and analytic software solutions that help organizations improve

More information

IT Infrastructure Services. White Paper. Utilizing Software Defined Network to Ensure Agility in IT Service Delivery

IT Infrastructure Services. White Paper. Utilizing Software Defined Network to Ensure Agility in IT Service Delivery IT Infrastructure Services White Paper Utilizing Software Defined Network to Ensure Agility in IT Service Delivery About the Author Siddhesh Rane Siddhesh Rane is a Technical Architect and part of the

More information

Ab Initio in Enterprise Application Integration

Ab Initio in Enterprise Application Integration Ab Initio in Enterprise Application Integration The recent pace of technological and environment changes have led to massive structural as well as operational changes as to how the organization is managed

More information

Advanced Big Data Analytics with R and Hadoop

Advanced Big Data Analytics with R and Hadoop REVOLUTION ANALYTICS WHITE PAPER Advanced Big Data Analytics with R and Hadoop 'Big Data' Analytics as a Competitive Advantage Big Analytics delivers competitive advantage in two ways compared to the traditional

More information

Business Process Services. White Paper. Providing Customer Service the Social Way

Business Process Services. White Paper. Providing Customer Service the Social Way Business Process Services White Paper Providing Customer Service the Social Way About the Author Awani Sarogi Awani is a subject matter expert in digital media, developing digital media solutions and offerings

More information

Application Consolidation

Application Consolidation Application Consolidation As enterprises look for ways to reduce costs and simplify IT management, they often consider various approaches to server consolidation. Among them, application consolidation

More information

Managing Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database

Managing Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica

More information