- Experiencing the pitfalls of poor data quality and failing to benefit from good data quality, including:
- Unreliable data and unfavorable output.
- Inefficiencies and costly remedies.
- Dissatisfied stakeholders.
- The chances of successful decision-making capabilities are hindered with poor data quality.
Our Advice
Critical Insight
- Address the root causes of your data quality issues and form a viable data quality program.
- Be familiar with your organization’s data environment and business landscape.
- Prioritize business use cases for data quality fixes.
- Fix data quality issues at the root cause to ensure proper foundation for your data to flow.
- It is important to sustain best practices and grow your data quality program.
Impact and Result
- Implement a set of data quality initiatives that are aligned with overall business objectives and aimed at addressing data practices and the data itself.
- Develop a prioritized data quality improvement project roadmap and long-term improvement strategy.
- Build related practices such as artificial intelligence and analytics with more confidence and less risk after achieving an appropriate level of data quality.
Member Testimonials
After each Info-Tech experience, we ask our members to quantify the real-time savings, monetary impact, and project improvements our research helped them achieve. See our top member experiences for this blueprint and what our clients have to say.
9.7/10
Overall Impact
$57,811
Average $ Saved
45
Average Days Saved
Client
Experience
Impact
$ Saved
Days Saved
Geidea
Guided Implementation
9/10
N/A
N/A
Clear explanations from Wayne, perfect planning for building data quality program as MVP as starting point, and interesting session and templates... Read More
South African Reserve Bank
Guided Implementation
9/10
$30,549
18
The reinforcement of the SARB's approach and the advice given was the best part of the experience.
FirstRand Bank Ltd.
Guided Implementation
10/10
$11,699
9
Oregon Department of Employment
Workshop
10/10
$125K
120
The facilitator was excellent. Reddy was prepared with all the materials and knowledge from our prior Data Governance workshop, so the experience w... Read More
City Of Chesapeake
Workshop
10/10
$62,999
60
This workshop helped our team dedicate time over a fixed week instead of this effort being spread over a few months. This gave the team a kick sta... Read More
Elara Caring
Guided Implementation
10/10
N/A
20
Tailored advice by the experts certainly has been the best part.
MHI Canada Aerospace, Inc.
Guided Implementation
9/10
N/A
2
Atlantic Canada Opportunities Agencies
Guided Implementation
6/10
$10,000
2
University of Pittsburgh Medical Center
Workshop
9/10
$247K
50
Workshop exceeded expectations. Excellent blend of data quality aligning to our business. The metrics, critical data elements, workflows were extre... Read More
Transport Canada
Workshop
8/10
N/A
N/A
The workshop was well delivered and the documents reflect what was discussed during the workshop. It would be a good idea to have a real life exam... Read More
Arizona Department of Environmental Quality
Guided Implementation
9/10
$7,439
5
Unknowns at this time. Depends on implementation and resources required and then measured gains. I was late to the call today. Apologies for bei... Read More
Central Arizona Project
Guided Implementation
9/10
N/A
20
Libro Credit Union
Guided Implementation
9/10
N/A
N/A
This was just an introduction so unfortunately i can not quantify cost or dollar savings yet.
TriServe Tech
Guided Implementation
10/10
$12,733
5
Best => Give me an idea how to start with a Data Quality project Worst => N/A
Data Quality
A manifesto for strategic data quality improvement.
This course makes up part of the Data & BI Certificate.
- Course Modules: 5
- Estimated Completion Time: 2-2.5 hours
- Featured Analysts:
- Crystal Singh, Research Director, Applications
- David Piazza, VP of Research & Advisory, Applications Practice
Workshop: Build Your Data Quality Program
Workshops offer an easy way to accelerate your project. If you are unable to do the project yourself, and a Guided Implementation isn't enough, we offer low-cost delivery of our project workshops. We take you through every phase of your project and ensure that you have a roadmap in place to complete your project successfully.
Module 1: Define Your Organization’s Data Environment and Business Landscape
The Purpose
- Evaluate the maturity of the existing data quality practice and activities.
- Assess how data quality is embedded into related data management practices.
- Envision a target state for the data quality practice.
Key Benefits Achieved
- Understanding of the current data quality landscape
- Gaps, inefficiencies, and opportunities in the data quality practice are identified
- Target state for the data quality practice is defined
Activities
Outputs
Explain approach and value proposition
- Data Quality Management Primer
Detail business vision, objectives, and drivers
- Business Capability Map Template
Discuss data quality barriers, needs, and principles
- Data Culture Diagnostic
Assess current enterprise-wide data quality capabilities
- Data Quality Diagnostic
Identify data quality practice future state
- Data Quality Problem Statement Template
Analyze gaps in data quality practice
Module 2: Create a Strategy for Data Quality Project 1
The Purpose
- Define improvement initiatives
- Define a data quality improvement strategy and roadmap
Key Benefits Achieved
- Improvement initiatives are defined
- Improvement initiatives are evaluated and prioritized to develop an improvement strategy
- A roadmap is defined to depict when and how to tackle the improvement initiatives
Activities
Outputs
Create business unit prioritization roadmap
- Business Unit Prioritization Roadmap
Develop subject areas project scope
- Subject area scope
By subject area 1 data lineage analysis, root cause analysis, impact assessment, and business analysis
- Data Lineage Diagram
Module 3: Create a Strategy for Data Quality Project 2
The Purpose
- Define improvement initiatives
- Define a data quality improvement strategy and roadmap
Key Benefits Achieved
- Improvement initiatives are defined
- Improvement initiatives are evaluated and prioritized to develop an improvement strategy
- A roadmap is defined to depict when and how to tackle the improvement initiatives
Activities
Outputs
Understand how data quality management fits in with the organization’s data governance and data management programs
By subject area 2 data lineage analysis, root cause analysis, impact assessment, and business analysis
- Data Lineage Diagram
- Root Cause Analysis
- Impact Analysis
Module 4: Create a Strategy for Data Quality Project 3
The Purpose
Determine a strategy for fixing data quality issues for the highest priority business unit
Key Benefits Achieved
Strategy defined for fixing data quality issues for highest priority business unit
Activities
Outputs
Formulate strategies and actions to achieve data quality practice future state
Formulate a data quality resolution plan for the defined subject area
- Data Quality Improvement Plan
By subject area 3 data lineage analysis, root cause analysis, impact assessment, and business analysis
- Data Lineage Diagram
Module 5: Create a Plan for Sustaining Data Quality
The Purpose
- Plan for continuous improvement in data quality
- Incorporate data quality management into the organization’s existing data management and governance programs
Key Benefits Achieved
- Sustained and communicated data quality program
Activities
Outputs
Formulate metrics for continuous tracking of data quality and monitoring the success of the data quality improvement initiative
- Data Quality Practice Improvement Roadmap
Workshop Debrief with Project Sponsor
- Data Quality Improvement Plan (for defined subject areas)
Meet with project sponsor/manager to discuss results and action items
Wrap up outstanding items from the workshop, deliverables expectations, GIs
Build Your Data Quality Program
Quality Data Drives Quality Business Decisions
Executive Brief
Analyst Perspective
Get ahead of the data curve by conquering data quality challenges.
Regardless of the driving business strategy or focus, organizations are turning to data to leverage key insights and help improve the organization’s ability to realize its vision, key goals, and objectives.
Poor quality data, however, can negatively affect time-to-insight and can undermine an organization’s customer experience efforts, product or service innovation, operational efficiency, or risk and compliance management. If you are looking to draw insights from your data for decision making, the quality of those insights is only as good as the quality of the data feeding or fueling them.
Improving data quality means having a data quality management practice that is sustainably successful and appropriate to the use of the data, while evolving to keep pace with or get ahead of changing business and data landscapes. It is not a matter of fixing one data set at a time, which is resource and time intensive, but instead identifying where data quality consistently goes off the rails, and creating a program to improve the data processes at the source.
Crystal Singh
Research Director, Data and Analytics
Info-Tech Research Group
Executive Summary
Your Challenge
Your organization is experiencing the pitfalls of poor data quality, including:
- Unreliable data and unfavorable output.
- Inefficiencies and costly remedies.
- Dissatisfied stakeholders.
Poor data quality hinders successful decision making.
Common Obstacles
Not understanding the purpose and execution of data quality causes some disorientation with your data.
- Failure to realize the importance/value of data quality.
- Unsure of where to start with data quality.
- Lack of investment in data quality.
Organizations tend to adopt a project mentality when it comes to data quality instead of taking the strategic approach that would be all-around more beneficial in the long term.
Info-Tech’s Approach
Address the root causes of your data quality issues by forming a viable data quality program.
- Be familiar with your organization’s data environment and business landscape.
- Prioritize business use cases for data quality fixes.
- Fixing data quality issues at the root cause to ensure a proper foundation for your data to flow.
It is important to sustain best practices and grow your data quality program.
Info-Tech Insight
Fix data quality issues as close as possible to the source of data while understanding that business use cases will each have different requirements and expectations from data quality.
Data is the foundation of your organization’s knowledge
Data enables your organization to make decisions.
Reliable data is needed to facilitate data consumers at all levels of the enterprise.
Insights, knowledge, and information are needed to inform operational, tactical, and strategic decision-making processes. Data and information are needed to manage the business and empower business processes such as billing, customer touchpoints, and fulfillment.
Raw Data
Business Information
Actionable Insights
Data should be at the foundation of your organization’s evolution. The transformational insights that executives are constantly seeking can be uncovered with a data quality practice that makes high-quality, trustworthy information readily available to the business users who need it.
98% of companies use data to improve customer experience. (Experian Data Quality, 2019)
High-Level Data Architecture
Build Your Data Quality Program
- Data Quality & Data Culture Diagnostics Business Landscape Exercise
- Business Strategy & Use Cases
- Prioritize Use Cases With Poor Quality
Info-Tech Insight
As data is ingested, integrated, and maintained in the various streams of the organization's system and application architecture, there are multiple points where the quality of the data can degrade.
- Understand the organization's data culture and data quality environment across the business landscape.
- Prioritize business use cases with poor data quality.
- For each use case, identify data quality issues and requirements throughout the data pipeline.
- Fix data quality issues at the root cause.
- As data flow through quality assurance monitoring checkpoints, monitor data to ensure good quality output.
Insight:
Proper application of data quality dimensions throughout the data pipeline will result in superior business decisions.
Data quality issues can occur at any stage of the data flow.
Prevent the domino effect of poor data quality
Data is the foundation of decisions made at data-driven organizations.
Therefore, if there are problems with the organization’s underlying data, this can have a domino effect on many downstream business functions.
Let’s use an example to illustrate the domino effect of poor data quality.
Organization X is looking to migrate their data to a single platform, System Y. After the migration, it has become apparent that reports generated from this platform are inconsistent and often seem wrong. What is the effect of this?
- Time must be spent on identifying the data quality issues, and often manual data quality fixes are employed. This will extend the time to deliver the project that depends on system Y by X months.
- To repair these issues, the business needs to contract two additional resources to complete the unforeseen work. The new resources cost $X each, as well as additional infrastructure and hardware costs.
- Now, the strategic objectives of the business are at risk and there is a feeling of mistrust in the new system Y.
Three key challenges impacting the ability to deliver excellent customer experience
30% Poor data quality
30% Method of interaction changing
30% Legacy systems or lack of new technology
95% Of organizations indicated that poor data quality undermines business performance.
(Source: Experian Data Quality, 2019)
Maintaining quality data will support more informed decisions and strategic insight
Improving your organization’s data quality will help the business realize the following benefits:
Data-Driven Decision Making
Business decisions should be made with a strong rationale. Data can provide insight into key business questions, such as, “How can I provide better customer satisfaction?”
89% Of CIOs surveyed say lack of quality data is an obstacle to good decision making. (Larry Dignan, CIOs juggling digital transformation pace, bad data, cloud lock0in and business alignment, 2020)
Customer Intimacy
Improve marketing and the customer experience by using the right data from the system of record to analyze complete customer views of transactions, sentiments, and interactions.
94% Percentage of senior IT leaders who say that poor data quality impinges business outcomes. (Clint Boulton, Disconnect between CIOs and LOB managers weakens data quality, 2016)
Innovation Leadership
Gain insights on your products, services, usage trends, industry directions, and competitor results to support decisions on innovations, new products, services, and pricing.
20% Businesses lose as much as 20% of revenue due to poor data quality. (RingLead Data Management Solutions, 10 Stats About Data Quality I Bet You Didn’t Know)
Operational Excellence
Make sure the right solution is delivered rapidly and consistently to the right parties for the right price and cost structure. Automate processes by using the right data to drive process improvements.
10-20% The implementation of data quality initiatives can lead to reductions in corporate budget of up to 20%. (HaloBI, 2015)
However, maintaining data quality is difficult
Avoid these pitfalls to get the true value out of your data.
- Data debt drags down ROI – a high degree of data debt will hinder you from attaining the ROI you’re expecting.
- Lack of trust means lack of usage – a lack of confidence in data results in a lack of data usage in your organization, which negatively effects strategic planning, KPIs, and business outcomes.
- Strategic assets become a liability – bad data puts your business at risk of failing compliance standards, which could result in you paying millions in fines.
- Increased costs and inefficiency – time spent fixing bad data means less workload capacity for your important initiatives and the inability to make data-based decisions.
- Barrier to adopting data-driven tech – emerging technologies, such as predictive analytics and artificial intelligence, rely on quality data. Inaccurate, incomplete, or irrelevant data will result in delays or a lack of ROI.
- Bad customer experience – Running your business on bad data can hinder your ability to deliver to your customers, growing their frustration, which negatively impacts your ability to maintain your customer base.
Info-Tech Insight
Data quality suffers most at the point of entry. This is one of the causes of the domino effect of data quality – and can be one of the most costly forms of data quality errors due to the error propagation. In other words, fix data ingestion, whether through improving your application and database design or improving your data ingestion policy, and you will fix a large majority of data quality issues.
Follow Our Data & Analytics Journey
Data Quality is laced into Data Strategy, Data Management, and Data Governance.
- Data Strategy
- Data Management
- Data Quality
- Data Governance
- Data Architecture
- MDM
- Data Integration
- Enterprise Content Management
- Information Lifecycle Management
- Data Warehouse/Lake/Lakehouse
- Reporting and Analytics
- AI
- Data Warehouse/Lake/Lakehouse
- Data Architecture
- Data Management
Data quality is rooted in data management
Extract Maximum Benefit Out of Your Data Quality Management.
- Data management is the planning, execution, and oversight of policies, practices, and projects that acquire, control, protect, deliver, and enhance the value of data and information assets (DAMA, 2009).
- In other words, getting the right information, to the right people, at the right time.
- Data quality management exists within each of the data practices, information dimensions, business resources, and subject areas that comprise the data management framework.
- Within this framework, an effective data quality practice will replace ad hoc processes with standardized practices.
- An effective data quality practice cannot succeed without proper alignment and collaboration across this framework.
- Alignment ensures that the data quality practice is fit for purpose to the business.
The DAMA DMBOK2 Data Management Framework
- Data Governance
- Data Quality
- Data Architecture
- Data Modeling & Design
- Data Storage & Operations
- Data Security
- Data Integration & Interoperability
- Documents & Content
- Reference & Master Data
- Data Warehousing & Business Intelligence
- Meta-data
(Source: DAMA International)
Related Info-Tech Research
Build a Robust and Comprehensive Data Strategy
- People often think that the main problems they need to fix first are related to data quality when the issues transpire at a much larger level. This blueprint is the key to building and fostering a data-driven culture.
Create a Data Management Roadmap
- Refer to this blueprint to understand data quality in the context of data disciplines and methods for improving your data management capabilities.
- Define an effective data governance strategy and ensure the strategy integrates well with data quality with this blueprint.
Info-Tech’s methodology for Data Quality
Phase Steps | 1. Define Your Organization’s Data Environment and Business Landscape | 2. Analyze Your Priorities for Data Quality Fixes | 3. Establish Your Organization’s Data Quality Program | 4. Grow and Sustain Your Data Quality Practice |
---|---|---|---|---|
Phase Outcomes | This step identifies the foundational understanding of your data and business landscape, the essential concepts around data quality, as well as the core capabilities and competencies that IT needs to effectively improve data quality. | To begin addressing specific, business-driven data quality projects, you must identify and prioritize the data-driven business units. This will ensure that data improvement initiatives are aligned to business goals and priorities. | After determining whose data is going to be fixed based on priority, determine the specific problems that they are facing with data quality, and implement an improvement plan to fix it. | Now that you have put an improvement plan into action, make sure that the data quality issues don’t keep cropping up. Integrate data quality management with data governance practices into your organization and look to grow your organization’s overall data maturity. |
Info-Tech Insight
“Data Quality is in the eyes of the beholder.”– Igor Ikonnikov, Research Director
Data quality means tolerance, not perfection
Data from Info-Tech’s CIO Business Vision Diagnostic, which represents over 400 business stakeholders, shows that data quality is very important when satisfaction with data quality is low.
However, when data quality satisfaction hit a threshold, it became less important.
Respondents were asked “How satisfied are you with the quality, reliability, and effectiveness of the data you use to manage your group?” as well as to rank how important data quality was to their organization.
When the business satisfaction of data quality reached a threshold value of 71-80%, the rated importance reached its lowest value.
Info-Tech Insight
Data needs to be good, but truly spectacular data may go unnoticed.
Provide the right level of data quality, with the appropriate effort, for the correct usage. This blueprint will help you to determine what “the right level of data quality” means, as well as create a plan to achieve that goal for the business.
Data Roles and Responsibilities
Data quality occurs through three main layers across the data lifecycle
Data Strategy Data Strategy should contain Data Quality as a standard component. ← Data Quality issues can occur throughout at any stage of the data flow → |
||||
DQ Dimensions Timeliness – Representation – Usability – Consistency – Completeness – Uniqueness – Entry Quality – Validity – Confidence – Importance |
||||
Source System Layer
|
Data Transformation Layer
|
Consumption Layer
|
||
Data Creation → | [SLA] Data Ingestion [ QA] | →Data Accumulation & Engineering → | [SLA] Data Delivery [QA] | →Reporting & Analytics |
Fix Data Quality root causes here… | → | to prevent expensive cures here. |
Executive Brief Case Study
Industry: Healthcare
Source: Primary Info-Tech Research
Align source systems to maximize business output.
A healthcare insurance agency faced data quality issues in which a key business use case was impacted negatively. Business rules were not well defined, and default values instead of real value caused a concern. When dealing with multiple addresses, data was coming from different source systems.
The challenge was to identify the most accurate address, as some were incomplete, and some lacked currency and were not up to date. This especially challenged a key business unit, marketing, to derive business value in performing key activities by being unable to reach out to existing customers to advertise any additional products.
For this initiative, this insurance agency took an economic approach by addressing those data quality issues using internal resources.
Results
Without having any MDM tools or having a master record or any specific technology relating to data quality, this insurance agency used in-house development to tackle those particular issues at the source system. Data quality capabilities such as data profiling were used to uncover those issues and address them.
“Data quality is subjective; you have to be selective in terms of targeting the data that matters the most. When getting business tools right, most issues will be fixed and lead to achieving the most value.” – Asif Mumtaz, Data & Solution Architect
Info-Tech offers various levels of support to best suit your needs
DIY Toolkit
"Our team has already made this critical project a priority, and we have the time and capability, but some guidance along the way would be helpful."
Guided Implementation
"Our team knows that we need to fix a process, but we need assistance to determine where to focus. Some check-ins along the way would help keep us on track."
Workshop
"We need to hit the ground running and get this project kicked off immediately. Our team has the ability to take this over once we get a framework and strategy in place."
Consulting
"Our team does not have the time or the knowledge to take this project on. We need assistance through the entirety of this project."
Diagnostic and consistent frameworks are used throughout all four options.
Guided Implementation
What does a typical GI on this topic look like?
Phase 1 | Phase 2 | Phase 3 | Phase 4 |
---|---|---|---|
|
|
|
|
A Guided Implementation (GI) is a series of calls with an Info-Tech analyst to help implement our best practices in your organization.
A typical GI is between eight to twelve calls over the course of four to six months.
Workshop Overview
Contact your account representative for more information. workshops@infotech.com 1-888-670-8889
Day 1 | Day 2 | Day 3 | Day 4 | Day 5 | |
---|---|---|---|---|---|
Define Your Organization’s Data Environment and Business Landscape | Create a Strategy for Data Quality Project 1 | Create a Strategy for Data Quality Project 2 | Create a Strategy for Data Quality Project 3 | Create a Plan for Sustaining Data Quality | |
Activities |
|
|
|
|
|
Deliverables |
|
|
|
|
|