Apache Spark 3 for Data Engineering and Analytics with Python

Master Python and PySpark 3.0.1 for Data Engineering / Analytics (Databricks) About This Video Apply PySpark and SQL concepts to analyze data Understand the Databricks interface and use Spark on Databricks Learn Spark transformations and actions using the RDD (Resilient Distributed Datasets) API In...

Full description

Bibliographic Details
Main Author: Mngadi, David
Format: eBook
Language:English
Published: Packt Publishing 2021
Edition:1st edition
Subjects:
Online Access:
Collection: O'Reilly - Collection details see MPG.ReNa
LEADER 02883nmm a2200289 u 4500
001 EB002003425
003 EBX01000000000000001166326
005 00000000000000.0
007 cr|||||||||||||||||||||
008 211025 ||| eng
100 1 |a Mngadi, David 
245 0 0 |a Apache Spark 3 for Data Engineering and Analytics with Python  |c Mngadi, David 
250 |a 1st edition 
260 |b Packt Publishing  |c 2021 
300 |a 1 video file, approximately 8 hr., 31 min. 
653 |a Vidéo en continu 
653 |a Vidéos sur Internet 
653 |a Internet videos / http://id.loc.gov/authorities/subjects/sh2007001612 
653 |a streaming video / aat 
653 |a Streaming video / http://id.loc.gov/authorities/subjects/sh2005005237 
041 0 7 |a eng  |2 ISO 639-2 
989 |b OREILLY  |a O'Reilly 
500 |a Made available through: Safari, an O'Reilly Media Company 
776 |z 9781803244303 
856 4 0 |u https://learning.oreilly.com/videos/~/9781803244303/?ar  |x Verlag  |3 Volltext 
082 0 |a 000 
520 |a Master Python and PySpark 3.0.1 for Data Engineering / Analytics (Databricks) About This Video Apply PySpark and SQL concepts to analyze data Understand the Databricks interface and use Spark on Databricks Learn Spark transformations and actions using the RDD (Resilient Distributed Datasets) API In Detail Apache Spark 3 is an open-source distributed engine for querying and processing data. This course will provide you with a detailed understanding of PySpark and its stack. This course is carefully developed and designed to guide you through the process of data analytics using Python Spark. The author uses an interactive approach in explaining keys concepts of PySpark such as the Spark architecture, Spark execution, transformations and actions using the structured API, and much more. You will be able to leverage the power of Python, Java, and SQL and put it to use in the Spark ecosystem. You will start by getting a firm understanding of the Apache Spark architecture and how to set up a Python environment for Spark. Followed by the techniques for collecting, cleaning, and visualizing data by creating dashboards in Databricks. You will learn how to use SQL to interact with DataFrames. The author provides an in-depth review of RDDs and contrasts them with DataFrames. There are multiple problem challenges provided at intervals in the course so that you get a firm grasp of the concepts taught in the course. Who this book is for This course is designed for Python developers who wish to learn how to use the language for data engineering and analytics with PySpark. Any aspiring data engineering and analytics professionals. Data scientists/analysts who wish to learn an analytical processing strategy that can be deployed over a big data cluster. Data managers who want to gain a deeper understanding of managing data over a cluster