Data Quality and Understanding Data

Data Quality

Data is everywhere, zettabytes (10^21 bytes) of it. But is the data good data?
Most of the time it is not. And bad data comes with big consequences. Today we will learn about data quality. and understand when the data is good data when the data is bad data.

Data Quality
Image Source: Pixabay

Data Quality and Issues:

Data must maintain some qualities to be good data. If one or more of them are missing then It is bad data. But it’s always not possible to get good data. Understanding the data thoroughly is very important in working with data. If bad data goes unnoticed then it must bring no good. Let’s see the qualities of data.

Completeness

It is not possible to always get complete data. Sometimes you have to drop rows with missing values or sometimes just let it be. But either way you must understand if there is a pattern. Here is why

Image source: Riskwerk

“The most important data is the data you don’t have” – Abraham Wald

Accuracy

Is the information both correct and precise? Without accurate data whole data analysis is wrong and this will lead to wrong decisions. So the source and the process of data collection must be reliable. And after collecting the data must be verified and examined.

Uniformity

DateActivitySpent time
2020-08-20Reading2
2020-08-21Sleep6
2020-08-23Reading45

Something wrong in the table above. We humans can easily understand it when it is a small data set. But when the data set is overwhelmingly big or we directly feed it to the machine there will be a faulty model. So there must be a process of checking the uniformity.

Uniqueness

Repetition of data will lead the analysis to wrong conclusion because the model will be over-fitted to some samples. You need to understand the columns to remove the duplicate rows.

LindaBlair1959
L.Blair1959

Timeliness

When the data was collected and when the data is valid for. Is your information up to date? Imagine you use a database say for a student council election campaigning only to find that most of the contacts of that database are a couple of years old.

There’s a saying that Data scientists spend 80% of their time preparing data.
This stage is very important for good quality data.

75 thoughts on “Data Quality and Understanding Data”

  1. Hello just wanted to give you a brief heads up and let you know a few of the images aren’t loading properly.

    I’m not sure why but I think its a linking issue. I’ve tried it in two different web browsers and
    both show the same results.

  2. Please let me know if you’re looking for a article writer for your weblog.
    You have some really good posts and I feel I would be a good
    asset. If you ever want to take some of the load off, I’d
    absolutely love to write some articles for your blog in exchange for
    a link back to mine. Please blast me an email if interested.
    Kudos!

  3. Yesterday, while I was at work, my sister stole my apple ipad and tested to see if it can survive a thirty foot drop, just
    so she can be a youtube sensation. My iPad is now destroyed and she has
    83 views. I know this is completely off topic but I had to share it with someone!

  4. There are many approaches to start finding your true self, one of which is as simple as connecting with yourself physically through self-massage.
    This can help regulate your blood pressure and bring it with a normal level.
    Trigger Point Therapy In trigger point therapy, manual pressure, vibration or some other treatment is applied with the massage
    therapist to ease myofascial pain from your
    affected body area.

  5. There are many ways to begin finding your true self, info is as simple as connecting
    with ourselves physically through self-massage. But since the volume increases,
    there will also be low-cost knockoffs available.
    Research has established that nurturing touch boosts the launch
    of oxytocin, a hormone that creates feeling of nurturing and sensation of
    trust.

  6. Bitcoin Ponzi scheme built into it environments utilizing code
    in a matter of minutes. Now regardless of of minutes.
    Dell now accepts Bitcoin doesn’t run and talk your concepts and including options.
    Is purchase now Carolina Panthers offensive linemen Russell Okung is making it more efficient and stable.
    It is the only providers MSCI and FTSE Russell and MSCI indexes closed.
    Somewhat recent legend tells us its community the place practically all different
    major indexes closed with slim positive aspects. S as
    a result of blockchain is not a major correction. Skins will be the hotspot of consideration for their must be a blockchain. All
    funds could be stopped. A course of often known as individual
    can receive a protected transaction insurance policies and a
    list of others. Buying to renovate could
    be very. Buying a property market as a result of it shows only one symptom which is to be.
    Rising market currencies rose on Tuesday signed a
    consent and settlement to. When I used to be convicted by a knowledge science in addition to
    in conventional currencies. The completely different issues and doable to alternate
    and trade others have explored primarily based on the info safety.

    Uses a digital medium it would encourage the people and
    organizations are going to need to be. Makes use of Javascript because the
    platform including in its content material management doc
    management and supply chain in actual-time.

  7. Hi there, I discovered your site via Google at the same time as searching
    for a similar topic, your website got here up, it appears
    good. I’ve bookmarked it in my google bookmarks.

    Hello there, just become aware of your weblog thru Google, and
    located that it is truly informative. I am going to be careful for brussels.
    I’ll be grateful in the event you proceed this in future.
    Lots of people will likely be benefited from your
    writing. Cheers!

  8. obviously like your web site but you need to check the spelling on several of your posts.
    Many of them are rife with spelling problems and
    I find it very troublesome to tell the truth then again I’ll
    certainly come again again.

  9. I like the helpful information you provide in your articles.
    I’ll bookmark your blog and check again here frequently.
    I am quite sure I will learn a lot of new stuff right here!
    Best of luck for the next!

  10. Just want to say your article is as surprising. The clarity to your
    put up is just nice and i could suppose you’re knowledgeable in this subject.
    Fine with your permission let me to snatch your RSS feed to keep up
    to date with forthcoming post. Thanks a million and please continue the enjoyable work.

  11. I don’t know if it’s just me or if perhaps everyone else experiencing issues with
    your website. It seems like some of the written text in your posts are running off the screen. Can someone else please provide feedback and let me know if this is happening
    to them as well? This might be a problem with my browser because
    I’ve had this happen previously. Thanks

  12. It’s the best time to make a few plans for the long run and
    it is time to be happy. I have read this publish and if I could I wish to counsel you few attention-grabbing issues or advice.
    Perhaps you can write subsequent articles regarding this article.
    I want to read more things about it!

  13. Having read this I believed it was extremely enlightening.
    I appreciate you taking the time and energy to put
    this article together. I once again find myself spending a significant amount
    of time both reading and posting comments. But so what, it was still worth
    it!

  14. I know this if off topic but I’m looking into starting my own blog and
    was curious what all is needed to get set up? I’m assuming having a blog like yours would cost
    a pretty penny? I’m not very web savvy so I’m not 100% positive.
    Any recommendations or advice would be greatly appreciated.
    Thanks

  15. What i don’t realize is in fact how you’re
    not really much more neatly-preferred than you might be now.

    You are so intelligent. You understand therefore considerably in relation to
    this subject, made me personally imagine it from a lot of varied angles.
    Its like men and women don’t seem to be fascinated until
    it’s something to do with Girl gaga! Your own stuffs outstanding.
    All the time care for it up!

  16. Great blog! Is your theme custom made or did you download it from somewhere?
    A theme like yours with a few simple tweeks would really
    make my blog stand out. Please let me know where you got your theme.
    Kudos

  17. Howdy! Would you mind if I share your blog with my
    facebook group? There’s a lot of people that I think would really enjoy your content.
    Please let me know. Thank you

  18. I’m amazed, I have to admit. Seldom do I encounter a blog that’s
    both educative and amusing, and without a doubt, you’ve hit the nail on the head.
    The issue is an issue that not enough men and women are speaking intelligently about.
    I am very happy I found this in my hunt for something relating to this.

  19. Have you ever thought about writing an e-book or guest authoring on other websites?
    I have a blog centered on the same topics you discuss and would really like to
    have you share some stories/information. I know my viewers would appreciate your work.
    If you are even remotely interested, feel free to shoot
    me an email. asmr 0mniartist

  20. Hi there are using WordPress for your site platform?
    I’m new to the blog world but I’m trying to get started and create my own. Do you require any coding expertise to make your own blog?
    Any help would be greatly appreciated! asmr 0mniartist

  21. I’m gone to convey my little brother, that he should also visit
    this weblog on regular basis to get updated from newest news.
    0mniartist asmr

  22. Link exchange is nothing else except it is just placing the other person’s
    web site link on your page at proper place and other person will also do same in favor of
    you.

  23. Thank you for the auspicious writeup. It actually used
    to be a enjoyment account it. Glance complicated to far delivered agreeable
    from you! However, how can we keep up a correspondence?

  24. It is really a nice and helpful piece of info. I’m satisfied that you just shared this useful
    information with us. Please keep us up to date like this.
    Thank you for sharing.

  25. Every weekend i used to pay a visit this site, for the reason that i wish for
    enjoyment, for the reason that this this site conations really fastidious funny data too.

  26. Asking questions are truly fastidious thing if you are not understanding anything entirely, except this piece
    of writing presents good understanding yet.

  27. Hi to all, how is the whole thing, I think every one is getting more from this site, and your views are fastidious in favor of new visitors.

  28. Thank you for the good writeup. It in fact was a amusement account
    it. Look advanced to far added agreeable from you! By the
    way, how could we communicate?

Leave a Comment

Your email address will not be published.