Categorías

Scaling Python for Data Science Using Apache Spark (Garren Staubli)

Publicado el: 27 septiembre 2018
en el canal de: Databricks
329
4

Garren Staubli, a Senior Data Engineer at Blueprint Consulting Services, discusses how python is the de facto language of data science and engineering, which affords it an outsized community of users. However, when many data scientists and engineers come to Spark with a Python background, unexpected performance potholes can stand in the way of progress. These “Performance Potholes” include PySpark’s ease of integration with existing packages (e.g. Pandas, SciPy, Scikit Learn, etc), using Python UDFs, and utilizing the RDD APIs instead of Spark SQL DataFrames without understanding the implications..

Learn more here: https://databricks.com/session/apache...

Article you might like: https://databricks.com/session/analyz...
About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unifie...

Connect with us:
Website: https://databricks.com
Facebook:   / databricksinc  
Twitter:   / databricks  
LinkedIn:   / databricks  
Instagram:   / databricksinc   Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-nam...

En esta página del sitio puede ver el video en línea Scaling Python for Data Science Using Apache Spark (Garren Staubli) de Duración hora minuto segunda en buena calidad , que subió el usuario Databricks 27 septiembre 2018, comparta el enlace con amigos y conocidos, en youtube este video ya ha sido visto 329 veces y le gustó 4 a los espectadores. Disfruta viendo!

play_arrow
17,888
128

Fixed Telegram App Login Problem | Telegram Not Working | Telegram App Login Loading Problem Fix

Fixed Telegram App Login Problem | Telegram Not Working | Telegram App Login Loading Problem Fix
play_arrow
63,601
803

FAMILY GUY REACTS TO AFTERMATH ANIMATED + VOICELINES

FAMILY GUY REACTS TO AFTERMATH ANIMATED + VOICELINES
play_arrow
571
11

Minecraft Sky Wars [#23] :

Minecraft Sky Wars [#23] : "Долгожданная серия!"
play_arrow
6,297
like

Bank Manager Ripped Up Black Farmer’s $2M Check as Fake—Then the Screen Said Valid

Bank Manager Ripped Up Black Farmer’s $2M Check as Fake—Then the Screen Said Valid
play_arrow
8,015
87

BattleField 4: Can you Counter A Counter Knife?

BattleField 4: Can you Counter A Counter Knife?
play_arrow
2,047
78

CSC New Registration 2022 Kaise Kare 👮

CSC New Registration 2022 Kaise Kare 👮
play_arrow
496
0

Opening and Closing To The Trials Of Life Growing Up 1991 VHS 60fps

Opening and Closing To The Trials Of Life Growing Up 1991 VHS 60fps
play_arrow
11,269
96

From $3K Energy Bills to a $2,146 Credit | Amber for Batteries

From $3K Energy Bills to a $2,146 Credit | Amber for Batteries
Relatado
play_arrow
Mosaic AI Gateway - Secure and Govern your AI

Mosaic AI Gateway - Secure and Govern your AI
play_arrow
Data + AI Summit 2023

Data + AI Summit 2023
play_arrow
LLM Module 6: LLMOps | 6.7 Notebook Demo

LLM Module 6: LLMOps | 6.7 Notebook Demo
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.13.1 Notebook Demo Part 1

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.13.1 Notebook Demo Part 1
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.10 Task specific Evaluations

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.10 Task specific Evaluations
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.6 Fine Tuning: LLMs as a Service

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.6 Fine Tuning: LLMs as a Service
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.3 Applying Foundation LLMs

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.3 Applying Foundation LLMs
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.4 Fine Tuning: Few-shot Learning

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.4 Fine Tuning: Few-shot Learning
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.2 Module Overview

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.2 Module Overview
play_arrow
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.1 Introduction

LLM Module 4: Fine-tuning and Evaluating LLMs | 4.1 Introduction
play_arrow
LLM Module 3 - Multi-stage Reasoning | 3.7.1 Notebook Demo Part 1

LLM Module 3 - Multi-stage Reasoning | 3.7.1 Notebook Demo Part 1
play_arrow
LLM Module 3 - Multi-stage Reasoning | 3.3 Prompt Engineering

LLM Module 3 - Multi-stage Reasoning | 3.3 Prompt Engineering
play_arrow
LLM Module 3 - Multi-stage Reasoning | 3.1 Introduction

LLM Module 3 - Multi-stage Reasoning | 3.1 Introduction
play_arrow
LLM Module 3 - Multi-stage Reasoning | 3.2 Module Overview

LLM Module 3 - Multi-stage Reasoning | 3.2 Module Overview
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.8.2 Notebook Demo Part 2

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.8.2 Notebook Demo Part 2
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.8.1 Notebook Demo Part 1

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.8.1 Notebook Demo Part 1
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.6 Best Practices

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.6 Best Practices
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.5 Vector Stores

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.5 Vector Stores
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.2 Module Overview

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.2 Module Overview
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.4 Filtering

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.4 Filtering
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.3 How does Vector Search work

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.3 How does Vector Search work
play_arrow
LLM Module 2 - Embeddings, Vector Databases, and Search | 2.1 Introduction

LLM Module 2 - Embeddings, Vector Databases, and Search | 2.1 Introduction
play_arrow
LLM Module 1 - Applications with LLMs | 1.8 Summary

LLM Module 1 - Applications with LLMs | 1.8 Summary
play_arrow
LLM Module 1 - Applications with LLMs | 1.9 Notebook Demo

LLM Module 1 - Applications with LLMs | 1.9 Notebook Demo