Opinion: the dos and don’ts of CRM data migrationby
By Steve Tuck, Datanomic Ltd
According to the Gartner Research report 'Eight Steps to Implementing a Successful CRM Project', CRM project failures continue to run rife throughout organisations, with a failure rate at nearly 50 percent.
What the report itself fails to identify is that a significant number of these failures are in fact due to inadequate data resulting from deficient data migration practices. Poor data quality leads to poor user adoption and poor CRM performance; getting the data migration right is critical to success.
In my experience in working on numerous CRM migration projects, there are two key fundamental mistakes that are commonly made time and time again:
• Don’t assume that migrating data will be easy – Companies invest large sums of money, time and effort in buying and customising a new CRM system. However, all too often they overlook the challenge of populating it with fit for purpose data, leaving the migration to the last minute and then just dropping data from the legacy system straight into the new system. It’s like buying a new car and selecting the colour and a range of luxury options, but then fitting it with the engine and tyres from your old vehicle and wondering why it performs so badly.
• Don’t leave the data migration to the technical team alone – Whilst a data migration undoubtedly needs skilled technical staff to understand the physical data models and to extract and load data in an optimised way, the critical area of data transformation requires business knowledge. Key decisions about how information should be translated from one system to another, or how duplicated records should be matched and resolved, should be made by a business user and ratified by a governance board.
All too often, the implementation of a new CRM system is seen primarily as a technical challenge. The truth is that, to be successful, a CRM programme requires collaboration between the business and technical teams. The data migration element is not just about plumbing the two systems together; it’s about understanding the contents of the data and its business context and constructing a process that delivers data that is optimised to perform in the new system. This requires both time and effort.
The key steps to data migration
I believe there are eight key steps for ensuring a successful CRM data migration:
1. Establish a governance board - Establish a governance board that sits above both the CRM implementation and CRM data migration project. This should consist of representatives from both the business and the IT department.
2. Coordinate migration with implementation - Start the CRM data migration project at the same time as work on the tailoring and implementation of the CRM system itself begins. The migration project will often identify shortcomings in the system design – it’s best to identify these as early as possible in the project so that they can be properly address rather than worked around.
3. Identify all of the source systems - Unless you are doing a like-for-like system replacement, it is likely that the new system will need to be populated with information extracted from a number of legacy applications.
4. Make your historical decisions - Decide on an approach to migrating historical information; will all, some or none of it be migrated? This is most relevant when replacing a CRM system. Including historical data may dramatically increase the volume of data to be migrated (and consequently the time it takes), but not migrating it means you may need to maintain the old system for archive purposes.
5. One-off or iterative migration? - Assess up-front whether a one-off data migration is required, or if the project actually requires the ongoing integration of different systems. Many so-called migrations actually require continuing feeds of data to be in place.
6. Big bang or trickle? - Decide whether a 'big bang' approach is practical (is there sufficient downtime to execute the migration?) or if a phased or 'trickle' migration is required. Avoid the mistake of one insurance company that got to within a month of implementing a new CRM system before realising that it would take more than two weeks to migrate all of the data, but had only allowed for a 48 hour operational window in which to complete it.
7. Leverage subject matter experts - Use subject matter experts, from within the business to map data to the business level entities (customer, address, contact history) in the new system. When implementing a replacement system the mapping exercise should be repeated based on the legacy system entities to ensure that no critical data is left behind.
8. Decide if and where to de-duplicate - Identify whether the data migration needs to include a de-duplication process and where it will be done. If one is needed, must it be completed before the data is loaded to the new CRM system, or could it be done afterwards with the data in situ? As with business rules, those used to match and merge data should be designed by an empowered business user and also confirmed by the governance board.
At first sight, it appears that little has changed in the past 15 years since I managed my first CRM data migration project. Unfortunately, significant numbers of CRM implementations are still doomed to failure because inadequate attention is paid to the data that powers them.
However, attitudes are, I believe, changing and so too is the technology that is used to deliver data migrations. These projects are finally moving out of the darkened basement, largely thanks to innovative solutions that provide powerful functions through easy-to-use interfaces and enable both business users and IT specialists to collaborate effectively.
Steve Tuck is chief strategy officer for Datanomic Ltd, specialists in solutions for enabling master data management, compliance and data integration.