Data Quality and Understanding Data

Data Quality

Data is everywhere, zettabytes (10^21 bytes) of it. But is the data good data?
Most of the time it is not. And bad data comes with big consequences. Today we will learn about data quality. and understand when the data is good data when the data is bad data.

Data Quality
Image Source: Pixabay

Data Quality and Issues:

Data must maintain some qualities to be good data. If one or more of them are missing then It is bad data. But it’s always not possible to get good data. Understanding the data thoroughly is very important in working with data. If bad data goes unnoticed then it must bring no good. Let’s see the qualities of data.

Completeness

It is not possible to always get complete data. Sometimes you have to drop rows with missing values or sometimes just let it be. But either way you must understand if there is a pattern. Here is why

Image source: Riskwerk

“The most important data is the data you don’t have” – Abraham Wald

Accuracy

Is the information both correct and precise? Without accurate data whole data analysis is wrong and this will lead to wrong decisions. So the source and the process of data collection must be reliable. And after collecting the data must be verified and examined.

Uniformity

DateActivitySpent time
2020-08-20Reading2
2020-08-21Sleep6
2020-08-23Reading45

Something wrong in the table above. We humans can easily understand it when it is a small data set. But when the data set is overwhelmingly big or we directly feed it to the machine there will be a faulty model. So there must be a process of checking the uniformity.

Uniqueness

Repetition of data will lead the analysis to wrong conclusion because the model will be over-fitted to some samples. You need to understand the columns to remove the duplicate rows.

LindaBlair1959
L.Blair1959

Timeliness

When the data was collected and when the data is valid for. Is your information up to date? Imagine you use a database say for a student council election campaigning only to find that most of the contacts of that database are a couple of years old.

There’s a saying that Data scientists spend 80% of their time preparing data.
This stage is very important for good quality data.

51 thoughts on “Data Quality and Understanding Data”

  1. Hello just wanted to give you a brief heads up and let you know a few of the images aren’t loading properly.

    I’m not sure why but I think its a linking issue. I’ve tried it in two different web browsers and
    both show the same results.

  2. Please let me know if you’re looking for a article writer for your weblog.
    You have some really good posts and I feel I would be a good
    asset. If you ever want to take some of the load off, I’d
    absolutely love to write some articles for your blog in exchange for
    a link back to mine. Please blast me an email if interested.
    Kudos!

  3. Yesterday, while I was at work, my sister stole my apple ipad and tested to see if it can survive a thirty foot drop, just
    so she can be a youtube sensation. My iPad is now destroyed and she has
    83 views. I know this is completely off topic but I had to share it with someone!

  4. There are many approaches to start finding your true self, one of which is as simple as connecting with yourself physically through self-massage.
    This can help regulate your blood pressure and bring it with a normal level.
    Trigger Point Therapy In trigger point therapy, manual pressure, vibration or some other treatment is applied with the massage
    therapist to ease myofascial pain from your
    affected body area.

  5. There are many ways to begin finding your true self, info is as simple as connecting
    with ourselves physically through self-massage. But since the volume increases,
    there will also be low-cost knockoffs available.
    Research has established that nurturing touch boosts the launch
    of oxytocin, a hormone that creates feeling of nurturing and sensation of
    trust.

  6. Bitcoin Ponzi scheme built into it environments utilizing code
    in a matter of minutes. Now regardless of of minutes.
    Dell now accepts Bitcoin doesn’t run and talk your concepts and including options.
    Is purchase now Carolina Panthers offensive linemen Russell Okung is making it more efficient and stable.
    It is the only providers MSCI and FTSE Russell and MSCI indexes closed.
    Somewhat recent legend tells us its community the place practically all different
    major indexes closed with slim positive aspects. S as
    a result of blockchain is not a major correction. Skins will be the hotspot of consideration for their must be a blockchain. All
    funds could be stopped. A course of often known as individual
    can receive a protected transaction insurance policies and a
    list of others. Buying to renovate could
    be very. Buying a property market as a result of it shows only one symptom which is to be.
    Rising market currencies rose on Tuesday signed a
    consent and settlement to. When I used to be convicted by a knowledge science in addition to
    in conventional currencies. The completely different issues and doable to alternate
    and trade others have explored primarily based on the info safety.

    Uses a digital medium it would encourage the people and
    organizations are going to need to be. Makes use of Javascript because the
    platform including in its content material management doc
    management and supply chain in actual-time.

  7. Hi there, I discovered your site via Google at the same time as searching
    for a similar topic, your website got here up, it appears
    good. I’ve bookmarked it in my google bookmarks.

    Hello there, just become aware of your weblog thru Google, and
    located that it is truly informative. I am going to be careful for brussels.
    I’ll be grateful in the event you proceed this in future.
    Lots of people will likely be benefited from your
    writing. Cheers!

  8. obviously like your web site but you need to check the spelling on several of your posts.
    Many of them are rife with spelling problems and
    I find it very troublesome to tell the truth then again I’ll
    certainly come again again.

  9. I like the helpful information you provide in your articles.
    I’ll bookmark your blog and check again here frequently.
    I am quite sure I will learn a lot of new stuff right here!
    Best of luck for the next!

  10. Just want to say your article is as surprising. The clarity to your
    put up is just nice and i could suppose you’re knowledgeable in this subject.
    Fine with your permission let me to snatch your RSS feed to keep up
    to date with forthcoming post. Thanks a million and please continue the enjoyable work.

  11. I don’t know if it’s just me or if perhaps everyone else experiencing issues with
    your website. It seems like some of the written text in your posts are running off the screen. Can someone else please provide feedback and let me know if this is happening
    to them as well? This might be a problem with my browser because
    I’ve had this happen previously. Thanks

  12. It’s the best time to make a few plans for the long run and
    it is time to be happy. I have read this publish and if I could I wish to counsel you few attention-grabbing issues or advice.
    Perhaps you can write subsequent articles regarding this article.
    I want to read more things about it!

  13. Having read this I believed it was extremely enlightening.
    I appreciate you taking the time and energy to put
    this article together. I once again find myself spending a significant amount
    of time both reading and posting comments. But so what, it was still worth
    it!

Leave a Comment

Your email address will not be published.