PySpark DataFrame Tutorial: String | Date | Functions | Hands-on
Welcome to our comprehensive guide on mastering data manipulation with PySpark! In this PySpark tutorial, we dive into the essentials of working with dataframes, exploring crucial string and date functions, as well as the powerful when..otherwise case statement.
String Functions Covered:
1. substring
2. substring_index
3. trim, ltrim, rtrim
4. concat, concat_ws
5. Format string
6. lpad, rpad
7. regexp_replace
Date Functions Covered:
1. to_date
2. to_timestamp
3. from_unixtime
4. unix_timestamp
5. current_date
6. date_add
7. date_format
8. date_sub
9. datediff
10. dayofmonth
11. dayofweek
12. dayofyear
Case Statement Covered:
1. Simple when..otherwise
2. Nested when..otherwise
This video is the second installment in our PySpark dataframe series, where we delve into the most important functions in PySpark. Whether you're just starting with PySpark or looking to deepen your understanding, this video has something for everyone. Watch now and supercharge your data processing capabilities!
Timestamps:
0:00 Intro
0:29 String Functions
23:23 Date Functions
41:26 Case Statement - when..otherwise
45:39 Outro
📌 Connect with Us:
🔗 [ / pristine_ai ]
🔗 [ / pristine.ai ]
🔗 [ / pristineai ]
👍 If you find this video helpful, remember to LIKE, SHARE, and SUBSCRIBE for more exciting tech insights! 🌟
#apachespark #pyspark #dataengineering #datascience #data #machinelearning #spark #databricks #aws #gcp #azure #cloudera #dataframes #dataframe #dataanalytics
On this page of the site you can watch the video online PySpark DataFrame Tutorial: String | Date | Functions | Hands-on with a duration of hours minute second in good quality, which was uploaded by the user Mohit Jain 27 February 2024, share the link with friends and acquaintances, this video has already been watched 589 times on youtube and it was liked by 14 viewers. Enjoy your viewing!
