A large part of my view of data is that you need to take the whole data lifecycle into consideration when working with data. It is not enough to only focus on the part of the process where you are currently working.
It is quite common that any issues with the incoming data is addressed in two ways:
- Sending angry emails to the team managing the source system and maybe escalating an incident.
- Swearing loudly at no-one and everyone
My approach to solving issues with the data are three things:
- Knowledge of the data lifecycle – Understand where the data originates and the path it takes into the data platform and where it goes from there. If you do not understand the lineage and path, you can only ever address the symptoms.
- Build relationships – Build relationships with the business that uses the data, but also with the business that creates the data in the first place. Then build relationships with the people working on the system(s) that generate the data you are using.
- Make data everyones problem – It is important that the business that needs correct data in the end of the process understands the path the data has taken and the reasons for the problems with the data. Only then can you all together take the long-term course of actions needed to have a sustainable data landscape.
So with that said, stop making data someone else’s problem and make it everyones problem.
But most importantly, if no-one is taking lead in ownership of data and the issues, then it is up to you to take the leadership position.