Data Validation

[Suphi]

@David Harper CFA FRM

Hello again

It helped me to get to grips with 'GARCH and EWMA issues' very much with help. I could not answer in the near future, unfortunately I live in an incredible intensity in my work.

Now I am again with a different question

Data validation I do not know if you are in your field of expertise but at least I think you know a few names where I can get some information

I will start to do data validation and as a starting point there will be a few responsibilities that need to be asked about the data related technical departments. In fact, my problem is that I have not been able to figure out what these questions are. What can I ask about data definition, data quality, data transfer and data structure? The questions that need to be answered regarding the data when ultimately validating the data in the world literature can be under these headings. I'm trying to do a good job and I believe I can do it if you help me.

I already thank you for your interest and help.

Edit:

For example for data transfer:

• Have any unwanted situations such as loss, deterioration, or alteration of data occurred during data transfer? How is it possible to control and maintain these possible situations?

• How is security provided during transfer?

Etc.

 

[David Harper CFA FRM]

Hi @Suphi Thanks for checking back. I've trained for a few years in my free time as a data scientist (using R) but data validation is not really an expertise of mine (I've done a fair amount of what is called data wrangling, which i sometimes perceive as more of an experienced-based art form than a science!). This sounds like maybe more of a consulting project. Have you heard of https://www.quandl.com/ out of Toronto? (their CDO has a webinar later this week, but not on this topic) They know all about this. Also, the folks at https://www.datacamp.com/ know people who definitely know all about it, and they are easy to reach. If you want to connect with me on LinkedIn, I might be able to facilitate an introduction with one of my contacts. But these are the two companies that I happen to know. My other (meta-) suggestion, actually, would be to join one of the major Coursera (https://www.coursera.org/) data science MOOCs? (e.g., John Hopkins, University of Washington). Or actually udacity, might be good, I just don't use it myself so I can't speak to it. Because with a bit of engagement, in my experience, you can easily virtually meet, in the forum, professions in the space. I bet you could get some relevant responses in the right course. I hope that's a little bit helpful, good luck!