Missingno Python Library | Visualising Missing Values in Data Prior to Machine Learning

Published: 08 September 2021
on channel: Andy McDonald
10,651
357

Missing data is probably one of the most common issues when working with real datasets. Data can be missing for a multitude of reasons, including sensor failure, data vintage, improper data management, and even human error. Missing data can occur as single values, multiple values within one feature, or entire features may be missing.
It is important that missing data is identified and handled appropriately prior to further data analysis or machine learning. Many machine learning algorithms can’t handle missing data and require entire rows, where a single missing value is present, to be deleted or replaced (imputed) with a new value.


If you haven't already, make sure you subscribe to the channel:    / @andymcdonald42  


----
The notebook for this video can be found on my GitHub repository at: https://github.com/andymcdgeo/Andys_Y...



There is a written version of this video available at: https://towardsdatascience.com/using-...


Libraries used in this video:
pandas: https://pandas.pydata.org
missingno: https://github.com/ResidentMario/miss...


Data Used in this video:
Bormann, Peter, Aursand, Peder, Dilib, Fahad, Manral, Surrender, & Dischington, Peter. (2020). FORCE 2020 Well well log and lithofacies dataset for machine learning competition [Data set]. Zenodo. http://doi.org/10.5281/zenodo.4351156

Books I Recommend:
As an Amazon Associate I earn from qualifying purchases. By buying through any of the links below I will earn commission at no extra cost to you.

PYTHON FOR DATA ANALYSIS: Data Wrangling with Pandas, NumPy, and IPython
UK: https://amzn.to/3HNycJ9
US: https://amzn.to/3DL7qPv

FUNDAMENTALS OF PETROPHYSICS
UK: https://amzn.to/3l1PgSf

PETROPHYSICS: Theory and Practice of Measuring Reservoir Rock and Fluid Transport Properties
UK: https://amzn.to/30UNWZS
US: https://amzn.to/3DNqBbd

WELL LOGGING FOR EARTH SCIENTISTS
UK: https://amzn.to/3FHsbfn
US: https://amzn.to/3CILAuE

GEOLOGICAL INTERPRETATION OF WELL LOGS
UK: https://amzn.to/3l2v2HV
US: https://amzn.to/30UOTkU
-----
Thanks for watching, if you want to connect you can find me at the links below:


  / andymcdonaldgeo  
  / geoandymcd  
  / andymcdonaldgeo  
https://www.andymcdonald.scot/


#missingdata #petrophysics #machinelearning #geoscience #missingno #python


On this page of the site you can watch the video online Missingno Python Library | Visualising Missing Values in Data Prior to Machine Learning with a duration of hours minute second in good quality, which was uploaded by the user Andy McDonald 08 September 2021, share the link with friends and acquaintances, this video has already been watched 10,651 times on youtube and it was liked by 357 viewers. Enjoy your viewing!