Listly by sakshimohite-df
Install Spark on your machine now and get started with Spark today.
Apache Spark Tutorial-what is spark, Spark overview, spark History, why Spark, Spark Component, Spark RDD, Spark Features, Spark Limitation, Spark use case
Apache Spark ecosystem and Spark components-Spark Core & its features,Spark SQL & SQL features,Spark Streaming,how streaming works,Spark MLlib,Graphx,SparkR
Apache Spark use cases to understand the benefits of learning spark & how you can apply them. Learn Real life use cases of spark in different industries
Learn Apache Spark features-Key features of Spark that create difference between Spark vs MapReduce Hadoop. Learn need of Spark and benefits of Apache Spark.
Install Spark, Apache Spark Installation On Ubuntu, What is Apache Spark, Why Spark, What is RDD in Spark, Spark features, creating RDD & Spark limitations.
Learn what is Dataframe in Apache Spark & need of Dataframe, features of Dataframe, how to create dataframe in Spark & limitations of Spark SQL DataFrame.
Spark dataset tutorial for Apache Spark dataset introduction, need of dataSet.Creating dataset in Spark, What is encoder in dataset & Spark dataset features
what is Spark SQL optimization & Spark SQL catalyst logical plan,physical plan,code generation,features of Catalyst optimizer,Rule & cost based optimization
Learn comparison between 3 data abstraction in Apache spark RDD vs DataFrame vs dataset performance & usage area of Spark RDD API,DataFrame API,DataSet API.
Apache Spark Streaming - what is streaming in Spark, need for Spark Streaming, Spark Streaming architecture & how it works, advantages of Streaming in Spark
Discretized Streams in Apache Spark cover what is DStream in spark, DStream stateless & stateful transformation,Spark DStream output operation,Input DStream
Spark Streaming transformation operations.What is Spark streaming & transformation operations in Spark-UpdateByKey(),CountByValue(),ReduceByKey(),filter()
Apache Spark Streaming Checkpoint introduction - what is Spark Checkpoint,spark Checkpointing types,Spark Checkpointing vs Persist,Caching and checkpointing
SparkR Machine Learning algorithms-Spark Machine Learning with R examples,Machine Learning Classification,Machine Learning Regression,Machine Learning Tree
Apache Spark MLlib-Featurization algorithms in Spark MLlib,Extraction, Transformers, Selectors,Sensitive Hashing Spark featurization in MLlib
Data Types in Spark Machine Learning- Spark MLlib Data Types in RDD-based API,datatypes-Local vector,Labeled point,Local matrix,Distributed matrix
SparkR Introduction to learn what is SparkR in terms of Spark, how to create sparkr DataFrames, operations on sparkr, machine learning algorithms in sparkr.
SparkDataFrames in SparkR, Ways to Create SparkDataFrame from local dataframes, create SparkDataFrame from hive table,create SparkDataFrame from Data source
Data type mapping between R and Spark,what is SparkR,SparkR Benefits:Data Sources API,Data Frame Optimizations,SparkR Scalability to Cores and Machines
In this article, we will learn the whole concept of SparkR DataFrame. Further, we will also learn SparkR DataFrame Operations.
Structured Streaming in SparkR- Example of Spark Structure streaming, Structure Streaming Programming Model In SparkR:Complete Mode,Append Mode, Update Mode
Learn about various decision making statements in Python like if statement, if else statement, elif ladder and nested if else with examples.
Learn about switch-case statements in Python, their working & their implementation in different ways. Check Python Interview Questions on it.
Loops are constructs that repeatedly execute a piece of code based on the conditions. See various types of loops in Python with examples.
Learn how to rename files in Python, incrementing or decrementing file names, renaming file to add date stamp and more functions.