Data Engineering and Developer Tools for Big Data
At JetBrains, we strive to build the most intelligent and ergonomic tools for developers. Whatever the language or technology stack, we aim to make the developer experience as amazing as possible.
Recently, we introduced Big Data Tools – a new IntelliJ IDEA plugin which integrates Spark and provides support for editing and running Zeppelin notebooks. This is why we've invited Jeff Zhang, an experienced data engineer, famous speaker, and contributor to big data related projects including Apache Zeppelin, to host a webinar.
Together, we explore what data engineering is about, what purpose it has, what the buzzword “Big Data” really stands for, and importantly, some examples of developer tools that are most instrumental and productive in doing data engineering. We dive into how data engineering contributes to Machine Learning and Exploratory Data Analysis, and what place #Spark, #Hadoop, #Zeppelin, and some other open-source tools occupy in the data engineering industry.
Resources:
Big Data Tools Plugin: https://plugins.jetbrains.com/plugin/...
Meet Big Data Tools: https://blog.jetbrains.com/scala/2019...
JetBrains Big Data Tools on Twitter: / bigdatatoolsjb
#BigData #IntelliJIDEA #MachineLearning #Plugin
About the Presenter:
Jeff Zhang has 11 years of experience in big data industry. He is an open source veteran, start to use hadoop since 2009 and is PMC of several Apache projects Tez/Livy/Zeppelin and committer of Apache Pig. His past experience is not only on big data infrastructure, but also on how to leverage these big data tools to get insight. He speaks several times on big data conferences like hadoop summit, strata + hadoop world. Now he works in Alibaba Group as a staff engineer. Prior that he works in Hortonworks where he developed these popular big data tools.
On this page of the site you can watch the video online Data Engineering and Developer Tools for Big Data with a duration of hours minute second in good quality, which was uploaded by the user JetBrains 13 December 2019, share the link with friends and acquaintances, this video has already been watched 4,518 times on youtube and it was liked by 92 viewers. Enjoy your viewing!
