Comments on: Data Quality Open Issues and Questions? http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/ Business Intelligence Redefined Wed, 16 Jun 2010 05:54:39 +0000 hourly 1 http://wordpress.org/?v=3.0 By: Recently Read: March 6, 2010 « Reblogger Memo Links http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-830 Recently Read: March 6, 2010 « Reblogger Memo Links Tue, 30 Mar 2010 18:23:00 +0000 http://www.dataforge.com/wpblog/?p=366#comment-830 [...] Data Quality Open Issues and Questions? – Jackie Roberts of DATAForge issues the blogosphere challenge of discussing real-world best practices for MDM, data governance, and data quality.  This blog post received some great comments. [...] [...] Data Quality Open Issues and Questions? – Jackie Roberts of DATAForge issues the blogosphere challenge of discussing real-world best practices for MDM, data governance, and data quality.  This blog post received some great comments. [...]

]]> By: Jackie Roberts http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-665 Jackie Roberts Wed, 03 Mar 2010 19:10:16 +0000 http://www.dataforge.com/wpblog/?p=366#comment-665 Julian, Just curious did you maintain the two different naming structures and providing a dynamic referencing system? Were each of the classification home grown or were they public classification structures? The classification of maintenance items is a challenge especially when you are working at multiple manufacturing facilities where the terminology and classifications are localized. We set up the standards, provided a clean classified and attributed record verified to the manufacturer of the component to the plant which improved our ability to standardize the MRO data up front. Part of our work with the maintenance and engineering departments was to set up synonym search capabilities which enhance the ability to find a part. Jackie Julian,
Just curious did you maintain the two different naming structures and providing a dynamic referencing system? Were each of the classification home grown or were they public classification structures?

The classification of maintenance items is a challenge especially when you are working at multiple manufacturing facilities where the terminology and classifications are localized. We set up the standards, provided a clean classified and attributed record verified to the manufacturer of the component to the plant which improved our ability to standardize the MRO data up front. Part of our work with the maintenance and engineering departments was to set up synonym search capabilities which enhance the ability to find a part.
Jackie

]]> By: Steve Sarsfield http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-664 Steve Sarsfield Wed, 03 Mar 2010 15:28:21 +0000 http://www.dataforge.com/wpblog/?p=366#comment-664 If that's your goal, it's groundbreaking and important work. Go get 'em. Keep a journal, because when it's all done, you should write the book. If that’s your goal, it’s groundbreaking and important work. Go get ‘em. Keep a journal, because when it’s all done, you should write the book.

]]> By: Jackie Roberts http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-663 Jackie Roberts Wed, 03 Mar 2010 15:17:50 +0000 http://www.dataforge.com/wpblog/?p=366#comment-663 Steve, Interesting enough, a standardized MRO schema is exactly what my goal is. Currently we classify (name) the MRO items to the manufacturer verified item name and attributes to describe the items. The standardization permits accuracy in purchasing and set up of tasking for maintenance. I have actually had an introductory meeting with Automotive Industry Action Group (AIAG), discussing the options of driving standard MRO naming conventions to support manufacturers, tier 1, tier 2, etc. We are working with ECCMA's Open Technical Dictionary to drive standard naming conventions and attributes providing a technical description to support not only purchasing but engineering and manufacturing. Jackie Steve,
Interesting enough, a standardized MRO schema is exactly what my goal is. Currently we classify (name) the MRO items to the manufacturer verified item name and attributes to describe the items. The standardization permits accuracy in purchasing and set up of tasking for maintenance. I have actually had an introductory meeting with Automotive Industry Action Group (AIAG), discussing the options of driving standard MRO naming conventions to support manufacturers, tier 1, tier 2, etc. We are working with ECCMA’s Open Technical Dictionary to drive standard naming conventions and attributes providing a technical description to support not only purchasing but engineering and manufacturing.

Jackie

]]> By: Jackie Roberts http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-662 Jackie Roberts Wed, 03 Mar 2010 15:00:10 +0000 http://www.dataforge.com/wpblog/?p=366#comment-662 Dave, If you are participating in Linked In, I have a Data Cleansing User Group to discuss and understand how to improve data quality. I also just created a parallel Google group. The statistics around Data Quality are overwhelming and there are mountains of discussions, white papers and tweets available pertaining to Data Quality, Governance, Profiling and Master Data Management. I think we need to take a step into the details to discuss and understand how to improve data quality by reviewing processes, sharing lessons learned and tips n' tricks of data cleansing. Jackie Dave,
If you are participating in Linked In, I have a Data Cleansing User Group to discuss and understand how to improve data quality. I also just created a parallel Google group. The statistics around Data Quality are overwhelming and there are mountains of discussions, white papers and tweets available pertaining to Data Quality, Governance, Profiling and Master Data Management. I think we need to take a step into the details to discuss and understand how to improve data quality by reviewing processes, sharing lessons learned and tips n’ tricks of data cleansing.

Jackie

]]> By: Steve Sarsfield http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-661 Steve Sarsfield Wed, 03 Mar 2010 14:53:59 +0000 http://www.dataforge.com/wpblog/?p=366#comment-661 What makes it so difficult is that business processes ultimately drive many of the things you mentioned, Jackie. So, in your example, the fields included in an MRO project would be driven by the business processes that are in play. We have to start by asking "what does the business need in order to accomplish its mission?" In my experience from the vendor side of things, the process would not only vary across industry, but vary within an industry. Ford wouldn't use the same MRO schema as Chrysler because they have different business processes. In Julian's response, you can see how the business processes of two similar companies challenged him - great insight into how processes drive schema. Ultimately, we're dependent upon factors like corporate history, business processes, partnerships, the corporation's position as a leader, and future business expansion plans to help us build a custom job every time. It certainly doesn't make the job of a consultant easy. Steve What makes it so difficult is that business processes ultimately drive many of the things you mentioned, Jackie. So, in your example, the fields included in an MRO project would be driven by the business processes that are in play. We have to start by asking “what does the business need in order to accomplish its mission?” In my experience from the vendor side of things, the process would not only vary across industry, but vary within an industry. Ford wouldn’t use the same MRO schema as Chrysler because they have different business processes.
In Julian’s response, you can see how the business processes of two similar companies challenged him – great insight into how processes drive schema.
Ultimately, we’re dependent upon factors like corporate history, business processes, partnerships, the corporation’s position as a leader, and future business expansion plans to help us build a custom job every time. It certainly doesn’t make the job of a consultant easy.
Steve

]]> By: Dave Pawson http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-659 Dave Pawson Wed, 03 Mar 2010 13:18:41 +0000 http://www.dataforge.com/wpblog/?p=366#comment-659 So are you going to set up a mailing list Jackie? Google groups or something? I guess the interest is there. DaveP So are you going to set up a mailing list Jackie? Google groups or something? I guess the interest is there.

DaveP

]]> By: Ken O'Connor http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-657 Ken O'Connor Wed, 03 Mar 2010 11:48:11 +0000 http://www.dataforge.com/wpblog/?p=366#comment-657 Jackie, Count me in too. I will be happy to share real world examples from my experience in requirements definition, sourcing, migrating, profiling, structuring, mismatching and re-verifying legacy system data. I look forward to learning from the experience of others. Working together we can achieve far more. Ken Jackie,

Count me in too.

I will be happy to share real world examples from my experience in requirements definition, sourcing, migrating, profiling, structuring, mismatching and re-verifying legacy system data.

I look forward to learning from the experience of others. Working together we can achieve far more.

Ken

]]> By: Dylan Jones http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-656 Dylan Jones Wed, 03 Mar 2010 09:38:53 +0000 http://www.dataforge.com/wpblog/?p=366#comment-656 Hi Jackie I hear you. One of my goals for Data Quality Pro was to create a channel for the many practitioners who can't find the time to get to conferences or even blog about how they are delivering these initiatives on the ground. I think the DQ/MDM/DG blogosphere has really expanded in the last 12 months but I agree we could do with a lot more case studies and practical accounts. Shameless plug coming up... I'm launching www.DQDirections.com late in Q2 this year to provide a virtual presentation platform for many of these case study organisations, many of them I'm sure will find their way out onto the blogosphere in the form of interviews and podcasts. In the meantime, I'm also keen to gather and collaborate on more "how" stories, theory is great but I agree we need more stories from the coalface. Hi Jackie

I hear you.

One of my goals for Data Quality Pro was to create a channel for the many practitioners who can’t find the time to get to conferences or even blog about how they are delivering these initiatives on the ground.

I think the DQ/MDM/DG blogosphere has really expanded in the last 12 months but I agree we could do with a lot more case studies and practical accounts.

Shameless plug coming up…

I’m launching http://www.DQDirections.com late in Q2 this year to provide a virtual presentation platform for many of these case study organisations, many of them I’m sure will find their way out onto the blogosphere in the form of interviews and podcasts.

In the meantime, I’m also keen to gather and collaborate on more “how” stories, theory is great but I agree we need more stories from the coalface.

]]> By: Julian Schwarzenbach http://www.dataforge.com/wpblog/index.php/jackie-roberts/data-quality-open-issues-and-questions/comment-page-1/#comment-655 Julian Schwarzenbach Wed, 03 Mar 2010 08:37:00 +0000 http://www.dataforge.com/wpblog/?p=366#comment-655 Jackie, To pick up on one of your questions - classification of maintenance items, I have a real world example that demonstrates just how challenging this can be! On a recent project I needed to develop the requirements for an asset register for a major rail project. The complication was the fact that different organisations would be managing the assets on completion of the project. The two main organisations have different asset classification structures which are totally incompatible. Due to their different origins, they reflect different classes of assets in different ways, have different levels of granularity, and different 'branches' in the tree structure. Additionally, both organisations are continuing to refine their classifications on an ongoing basis, with no synchronisation and no driver to adopt a more consistent approach. A further complication is that the CAD team use the Uniclass coding system, which is fine for buildings etc. but is light on the particular assets required. I was able to develop an approach which all parties are happy with, but this did make the overall process more complex than a typical infrastructure project. Hope this example is of some use. Julian Jackie,

To pick up on one of your questions – classification of maintenance items, I have a real world example that demonstrates just how challenging this can be!
On a recent project I needed to develop the requirements for an asset register for a major rail project. The complication was the fact that different organisations would be managing the assets on completion of the project. The two main organisations have different asset classification structures which are totally incompatible. Due to their different origins, they reflect different classes of assets in different ways, have different levels of granularity, and different ‘branches’ in the tree structure. Additionally, both organisations are continuing to refine their classifications on an ongoing basis, with no synchronisation and no driver to adopt a more consistent approach.

A further complication is that the CAD team use the Uniclass coding system, which is fine for buildings etc. but is light on the particular assets required.

I was able to develop an approach which all parties are happy with, but this did make the overall process more complex than a typical infrastructure project.

Hope this example is of some use.

Julian

]]>