Data Cleaning and Preprocessing using Python | Machine Learning and Data Science |
In this video we are using python library "samoy" for data cleaning.It is built on pandas but better in terms of efficiency and user level customization.
I have used data set from kaggle.
Lets understand samoy in brief:
Auto Data cleaner - "samoy"
samoy is a Python package for machine learning and data science, built on top of Pandas inbuilt libraries. This package will be useful for data pre-processing before starting off any machine learning or data science project as it will ease your entire process of data cleaning without much input from the user.
*User installation
If you already have a working installation of numpy and pandas, the easiest way to install samoy is using pip:
pip install samoy
---------------------------------
*Package Utilities
In current version of this package it only handles missing,null values and duplicates along with case conversion
Utilities supported:
1. Null values handling : Dropping and imputing(with mean,median as well as custom values)
2. Imputing null values with the threshold as mentioned by the user in terms of percentage
3. Missing values handling : Dropping and imputing(with mean,median and LRU)
4. Duplicates removal
5. Case conversion like if use wants to convert specific columns or entire column values into either lower or upper case
Samoy in Pypi : https://pypi.org/project/samoy/
Data Science Concepts:
• Complete Data Science Series | Statis...
Statistics Part 1 : • Statistics : How Statistics is Useful...
Statistics Part 2 : • Mean, Median, Percentile | Statistics...
Statistics Part 3 : • Statistical Distribution | Statistics...
Statistics Part 4 : • Hypothesis Testing | Statistics For D...
Please subscribe to the channel for amazing technological videos and comment on your doubts and requirement below.
Credit : Priyanka Singh (Gold Medalist in Computer Engineering SPPU Pune, M-Tech College of Engineering Pune, Ex Data Scientist From Reliance Industries Limited Mumbai.)
Priyanka Singh Linkedin :
/ priyanka-singh-350082116
Research Work in IEEE:
https://ieeexplore.ieee.org/document/...
Follow us on
Twitter : https://twitter.com/Forerun27232724?s=09
Facebook : / forerunners-110750477376350
Instagram : https://www.instagram.com/invites/con...
#DataScience #MachineLearning #Python
On this page of the site you can watch the video online Data Cleaning and Preprocessing using Python | Machine Learning and Data Science | with a duration of hours minute second in good quality, which was uploaded by the user Forerunners 20 August 2020, share the link with friends and acquaintances, this video has already been watched 7,996 times on youtube and it was liked by 97 viewers. Enjoy your viewing!
