Machine Learning with PySpark With Natural Language Processing and Recommender Systems

Master the new features in PySpark 3.1 to develop data-driven, intelligent applications. This updated edition covers topics ranging from building scalable machine learning models, to natural language processing, to recommender systems. Machine Learning with PySpark, Second Edition begins with the fu...

Full description

Bibliographic Details
Main Author: Singh, Pramod
Format: eBook
Language:English
Published: Berkeley, CA Apress 2022, 2022
Edition:2nd ed. 2022
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 03445nmm a2200337 u 4500
001 EB002010385
003 EBX01000000000000001173284
005 00000000000000.0
007 cr|||||||||||||||||||||
008 220201 ||| eng
020 |a 9781484277775 
100 1 |a Singh, Pramod 
245 0 0 |a Machine Learning with PySpark  |h Elektronische Ressource  |b With Natural Language Processing and Recommender Systems  |c by Pramod Singh 
250 |a 2nd ed. 2022 
260 |a Berkeley, CA  |b Apress  |c 2022, 2022 
300 |a XVIII, 220 p. 202 illus  |b online resource 
505 0 |a Chapter 1: Introduction to Spark 3.1 -- Chapter 2: Manage Data with PySpark -- Chapter 3: Introduction to Machine Learning -- Chapter 4: Linear Regression with PySpark -- Chapter 5: Logistic Regression with PySpark -- Chapter 6: Ensembling with PySpark -- Chapter 7: Clustering with PySpark -- Chapter 8: Recommendation Engine with PySpark -- Chapter 9: Advanced Feature Engineering with PySpark 
653 |a Machine learning 
653 |a Open source software 
653 |a Machine Learning 
653 |a Artificial Intelligence 
653 |a Python 
653 |a Artificial intelligence 
653 |a Open Source 
653 |a Python (Computer program language) 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
028 5 0 |a 10.1007/978-1-4842-7777-5 
856 4 0 |u https://doi.org/10.1007/978-1-4842-7777-5?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 006.31 
520 |a Master the new features in PySpark 3.1 to develop data-driven, intelligent applications. This updated edition covers topics ranging from building scalable machine learning models, to natural language processing, to recommender systems. Machine Learning with PySpark, Second Edition begins with the fundamentals of Apache Spark, including the latest updates to the framework. Next, you will learn the full spectrum of traditional machine learning algorithm implementations, along with natural language processing and recommender systems. You’ll gain familiarity with the critical process of selecting machine learning algorithms, data ingestion, and data processing to solve business problems. You’ll see a demonstration of how to build supervised machine learning models such as linear regression, logistic regression, decision trees, and random forests. You’ll also learn how to automate the steps using Spark pipelines, followed by unsupervised models such as K-means and hierarchical clustering. A section on Natural Language Processing (NLP) covers text processing, text mining, and embeddings for classification. This new edition also introduces Koalas in Spark and how to automate data workflow using Airflow and PySpark’s latest ML library. After completing this book, you will understand how to use PySpark’s machine learning library to build and train various machine learning models, along with related components such as data ingestion, processing and visualization to develop data-driven intelligent applications You will: Build a spectrum of supervised and unsupervised machine learning algorithms Use PySpark's machine learning library to implement machine learning and recommender systems Leverage the new features in PySpark’s machine learning library Understand data processing using Koalas in Spark Handle issues around feature engineering, class balance, bias and variance, and cross validation to build optimally fit models