Deprecated: mysql_connect(): The mysql extension is deprecated and will be removed in the future: use mysqli or PDO instead in /home/content/77/8880177/html/ipartner/db.php on line 2
Apache Spark, Scala, Storm Training -iPartner

Apache Spark, Scala, Storm Training

  1. Apache Spark, Scala, Storm Training
40 hr / 391*
(* including all taxes.)

Key Features

Course Agenda

  • Bayesian Law
  • Hadoop Distributed Computing
  • Big Data features
  • Legacy Architecture of Real Time System
  • Storm vs. Hadoop
  • Logical Dynamic and Components in Storm
  • Storm Topology
  • Execution Components in Storm
  • Stream Grouping
  • Tuple
  • Spout
  • Bolt-normalization bolt
  • Different types of Grouping
  • Reliable and unreliable messaging
  • Fetching data – Direct connection and En-queued message
  • Bolt Lifecycle
  • Trident Spouts and its types
  • Components and Interface of Trident spout
  • Trident Function, Filter & Aggregator
  • Twitter Boot Stripping
  • Detailed learning on Boot Stripping
  • Concepts of Storm
  • Storm Development Environment
  • What is Spark
  • Comparison with Hadoop
  • Components of Spark
    • Apache Spark- Introduction, Consistency, Availability, Partition
    • Unified Stack Spark
    • Spark Components
    • Comparison with Hadoop – Scalding example, mahout, storm, graph
  • Explain python example
  • Show installing a spark
  • Explain driver program
  • Explaining spark context with example
  • Define weakly typed variable
  • Combine scala and java seamlessly.
  • Explain concurrency and distribution.
  • Explain what is trait.
  • Explain higher order function with example.
  • Define OFI scheduler.
  • Advantages of Spark
  • Example of Lamda using spark
  • Explain Mapreduce with example

  • Difference between RISC and CISC
  • Define Apache Mesos
  • Cartesian product between two RDD
  • Define count
  • Define Filter
  • Define Fold
  • Define API Operations
  • Define Factors
  • How hadoop cluster is different from spark
  • Define writing data
  • Explain sequence file and its usefulness
  • Define protocol buffers
  • Define text file, CSV, Object Files and File System
  • Define sparse metrics
  • Explain RDD and Compression
  • Explain data stores and its usefulness
  • Motivation
  • Broadcast Variables
  • Example: Join
  • Alternative if one table is small
  • Better version with broadcast
  • How to create a Broadcast
  • Accumulators motivation
  • Example: Join
  • Accumulator Rules
  • Custom accumulators
  • Another common use
  • Creating an accumulator using spark context object
  • Task Scheduling/ distribution
  • Scheduling Around Applications
  • Static Partitioning
  • Dynamic Sharing
  • Scheduling Within An Application
  • Fair Scheduling
  • High Availability Of Spark Master
  • Standby Masters With Zookeeper
  • Single Node Recovery With Local File System
  • High Order Functions
  • Practicals : Creating Maps, Transformations
  • capacity planning in spark
  • concurrency in java
  • concurrency in scala
  • Array Buffers
  • Compact Buffer
  • Protocol Buffer
  • Log Analysis With Spark
  • First Log Analyzers In Spark
  • Introduction to Content Provider
  • Content Resolver & Content Provider
  • Use of Contaent Providers
  • TrueCaller App
  • Client Sever Work Model
  • Client Response Format
  • Android Core Concept
  • Introduction to Services
  • Types of Services
  • Service Life Cycle

  • Scala Overview
  • Advantages of Scala
  • REPL (Read Evaluate print loop)
  • Language Features
  • Type Interface
  • Higher order function
  • Option
  • Pattern Matching
  • Collection
  • Currying
  • Traits
  • Application Space
  • Uses of scala interpreter
  • Example of static object timer in scala
  • Testing of String equality in scala
  • Implicit classes in scala with examples.
  • Recursion in scala
  • Currying in scala with examples.
  • Classes in scala
  • Sealed traits
  • Case classes
  • Constant pattern in case classes
  • Wild card pattern
  • Variable pattern
  • Constructor pattern
  • Tuple pattern
  • Array in scala
  • List in scala
  • Difference between list and list buffer
  • Array buffer
  • Queue in scala
  • Dequeue in scala
  • Mutable queue in scala
  • Stacks in scala
  • Sets and maps in scala
  • Tuples
  • Different import types
  • Selective imports
  • Testing-Assertions
  • Scala test case- scala test fun. Suite
  • Junit test in scala
  • Interface for Junit via Junit 3 suite in scala test
  • SBT
  • Directory structure for packaging scala application
  • Mentee can select project from predefined set of iPartner projects or they can come up with their own ideas for their projects.

Learn & Get

  • Understand basic distributed concepts and Storm Architecture
  • Learn Hadoop Distributed Computing, Big Data features, Legacy architecture of Real-time System
  • Know the Logic Dynamics, Components and Topology in Storm
  • Understand the difference between Apache Spark and Hadoop
  • Learn Scala and its programming implementation
  • Get deep insights into the functioning of Scala
  • Implement Trident Spouts and understand Trident Filter, Function and Aggregator
  • Learn Twitter Boot Stripping
  • Work on Real-life Storm Project
  • Work on Minor and Major Projects applying programming techniques of Scala to run on Spark applications

Payment Method

You need to pay through PayPal. We accept both Debit and Credit Card for transaction.
We subsidize our fees by 10% for military personnel, and college students with exceptional records. To apply for a scholarship, email
In our iPartner self-paced training program, you will receive the training assessments, recorded sessions, course materials, Quizzes, related softwares and assignments. The courses are designed in such a way that you will the get real world exposure; the solid understanding of every concept that allows you to get the most from the online training experience and you will be able to apply the information and skills in the workplace. After the successful completion of your training program, you can take quizzes which enable you to check your level of knowledge and also enables you to clear your relevant certification at higher marks/grade where you will be able to work on the technologies independently.
In Self-paced courses, the learners are able to conduct hands-on exercises and produce learning deliverables entirely on their own at any convenient time without a facilitator whereas in the Online training courses, a facilitator will be available for answering queries at a specific time to be dedicated for learning. During your self-paced learning, you can learn more effectively when you interact with the content that is presented and a great way to facilitate this is through review questions and quizzes that strengthen key concepts. In case if you face any unexpected challenges while learning, we will arrange a live class with our trainer.
All Courses from iPartner are highly interactive to provide good exposure to learners and gives them a real time experience. You can learn only at a time where there are no distractions, which leads to effective learning. The costs of self-paced training are 75% cheaper than the online training. You will offer lifetime access hence you can refer it anytime during your project work or job.
Yes, at the top of the page of course details you can see sample videos.
As soon as you enroll to the course, your LMS (The Learning Management System) Access will be Functional. You will immediately get access to our course content in the form of a complete set of previous class recordings, PPTs, PDFs, assignments and access to our 24*7 support team. You can start learning right away.
24/7 access to video tutorials and Email Support along with online interactive session support with trainer for issue resolving.
Yes, You can pay difference amount between Online training and Self-paced course and you can be enrolled in next online training batch.
Please send an email. You can join our Live chat for instant solution.
We will provide you the links of the software to download which are open source and for proprietary tools, we will provide you the trail version if available.
You will have to work on a training project towards the end of the course. This will help you understand how the different components of courses are related to each other.
Classes are conducted via LIVE Video Streaming, where you get a chance to meet the instructor by speaking, chatting and sharing your screen. You will always have the access to videos and PPT. This would give you a clear insight about how the classes are conducted, quality of instructors and the level of Interaction in the class.
Yes, we do keep launching multiple offers that best suits your needs. Please email us at: and we will get back to you with exciting offers.
We will help you with the issue and doubts regarding the course. You can attempt the quiz again.
Sure! Your feedbacks are greatly appreciated. Please connect with us on the email support -