PacktPub - 50 Hours of Big Data, PySpark, AWS, Scala, and Scraping » downTURK

PacktPub - 50 Hours of Big Data, PySpark, AWS, Scala, and Scraping [Video]
English | Size: 17.33 GB
Category: Tutorial

Part 1 is designed to reflect the most in-demand Scala skills. It provides an in-depth understanding of core Scala concepts.

We will wrap up with a discussion on Map Reduce and ETL pipelines using Spark from AWS S3 to AWS RDS (includes six mini-projects and one Scala Spark project).

Part 2 covers PySpark to perform data analysis. You will explore Spark RDDs, Dataframes, a bit of Spark SQL queries, transformations, and actions that can be performed on the data using Spark RDDs and dataframes, the ecosystem of Spark and Hadoop, and their underlying architecture. You will also learn how we can leverage AWS storage, databases, computations, and how Spark can communicate with different AWS services.

Part 3 is all about data scraping and data mining. You will cover important concepts such as Internet Browser execution and communication with the server, synchronous and asynchronous, parsing data in response from the server, tools for data scraping, Python requests module, and more.

In Part 4, you will be using MongoDB to develop an understanding of the NoSQL databases. You will explore the basic operations and explore the MongoDB query, project and update operators. We will wind up this section with two projects: Developing a CRUD-based application using Django and MongoDB and implementing an ETL pipeline using PySpark to dump the data in MongoDB.

By the end of this course, you will be able to relate the concepts and practical aspects of learned technologies with real-world problems.

All the resources of this course are available at https://github.com/PacktPublishing/50-Hours-of-Big-Data-PySpark-AWS-Scala-and-Scraping

Author

AI Sciences, The AI Sciences Team is a group of experts, PhDs, and practitioners of artificial intelligence, computer science, machine learning, and statistics. Some of them work in big companies such as Amazon, Google, Facebook, Microsoft, KPMG, BCG, and IBM.

They have produced a series of courses mainly dedicated to beginners and newcomers on the techniques and methods of machine learning, statistics, artificial intelligence, and data science.

Their courses have had phenomenal success and have helped more than 100,000 students master AI and data science.

Buy Long-term Premium Accounts To Support Me & Max Speed

PacktPub - 50 Hours of Big Data, PySpark, AWS, Scala, and Scraping

If any links die or problem unrar, send request to http://goo.gl/aUHSZc

08

2022

PacktPub - 50 Hours of Big Data, PySpark, AWS, Scala, and Scraping

Related News

Packt - 50 Hours of Big Data, PySpark, AWS, Scala, and Scraping

Working with Apache Spark (Sept-2020)

Big Data Analysis with Apache Spark PySpark Hands on Python

Cloudera CCA 175 Spark Developer Certification: Hadoop Based

Apache Spark with Scala - Learn Spark from a Big Data Guru

Add Comment

Top Learning News

Iman Gadzhi - EDUCATE IO

Feibel Trading – The Ultimate Guide to Springs & Upthrusts

Aaron Alexander - Strong & Fit – Band Based Mobility Program

Catalyst: A Journal of Theory and Strategy

Pam Allen - Plain & Simple: 11 Knits to Wear Every Day

Wallin Marie - Cherish

Complete Guide to Application Packaging and Repackaging

Logging in Action, Video Edition

Linux Security - Basics and Beyond

An Introduction to Spatial Data Science with GeoDa: Volume 2: Clustering Spatial Data

Recommended Filehosts