Working with Pyspark & it's Optimizations

Explore
Data Engineering Accelerator S...
Working with Pyspark & it's Op...

Working with Pyspark & it's Optimizations

2 Scenarios

1 Hour 10 Minutes

Intermediate

project poster

Industry

e-commerce

Skills

data-wrangling

approach

problem-understanding

performance-tuning

data-storage

Tools

databricks

spark

Learning Objectives

Apply performance tuning strategies to improve job execution time

Overview

This practice set covers PySpark fundamentals and advanced optimization techniques

Prerequisites

Basic knowledge of Python & Spark