Apache Archives - Page 10 of 12

TECHNICS APACHE SPARK BEYOND THE BASICS TUTORIAL

11/05/2019 Learning for Life Leave a Comment

TECHNICS APACHE SPARK BEYOND THE BASICS TUTORIAL
English | Size: 520.17 MB
Category: Tutorial

| Writing Spark-SQL. This first clip in the Advanced Apache Spark video series covers Spark SQL. Also master SchemaRDD, which provides support for structured and semi-structured data Joining Tables in Apache Spark. This second clip in the Advanced Apache Spark video series explains how to join tables in Apache Spark Adding Columns and Checkpointing, and Performing Debugging in Apache Spark. This third clip in the Advanced Apache Spark video explains how to add columns and checkpoints in Spark, as well as how to perform debugging on your application code [Read more…]

SKILLSHARE BIG DATA ANALYSIS WITH APACHE SPARK PYSPARK PYTHON

15/04/2019 Learning for Life Leave a Comment

SKILLSHARE BIG DATA ANALYSIS WITH APACHE SPARK PYSPARK PYTHON
English | Size: 337.27 MB
Category: Tutorial

Spark can perform up to 100x faster than Hadoop MapReduce Data processing framework, Which makes apache spark one of most demanded skills.

The top companies like Google, Facebook, Microsoft, Amazon, Airbnb using Apache Spark to solve their big data problems!. Data analysis, on huge amount of data is one of the most valuable skills now a days and This course will teach such kind of skills to complete in big data job market. [Read more…]

Packt Apache Spark in 7 Days

23/03/2019 Learning for Life Leave a Comment

Packt Apache Spark in 7 Days
English | Size: 755.47 MB
Category: Tutorial

Video Description
If you’re looking to get up to speed with learning the fundamentals of Apache Spark in a short period of time, you can count on this course to help you learn the basics of this engine. Spark is becoming a popular big data processing engine with its unique ability to run in-memory with excellent speed. It is also easy to use and offers simple syntax.
[Read more…]

Linkedin Learning Apache PySpark by Example

11/02/2019 Learning for Life Leave a Comment

Linkedin Learning Apache PySpark by Example
English | Size: 261.02 MB
Category: CBTs

Want to get up and running with Apache Spark as soon as possible? If you’re well versed in Python, the Spark Python API (PySpark) is your ticket to accessing the power of this hugely popular big data platform. This practical, hands-on course helps you get comfortable with PySpark, explaining what it has to offer and how it can enhance your data
science work. To begin, instructor Jonathan Fernandes digs into the Spark ecosystem detailing its advantages over other data science platforms, APIs, and tool sets. Next, he looks at the DataFrame API and how it’s the platform’s answer to many big data challenges Finally, he goes over Resilient Distributed Datasets (RDDs), the building blocks of Spark [Read more…]

Apache Kafka Series – Learn Apache Kafka for Beginners

03/07/2018 Learning for Life Leave a Comment

Apache Kafka Series – Learn Apache Kafka for Beginner
English | Size: 1.03 GB
Category: CBTs

Learn about Apache Kafka Ecosystem, Architecture, Core Concepts and Operations
Master Fundamental Concepts behind Apache Kafka Like Topics, Partitions, Brokers, Producers, Consumers and Many More
Start a personal Kafka Cluster for development purposes (we’ll install and use Docker for this)
Create and Configure Topics and Start Writing Data to and Reading Data from Topic
Integrate with popular programming frameworks, such as Spark, Spark Streaming, Akka Actors, Akka Stream, Scala and Apache NiFi
Lehrplan für diesen Kurs
[Read more…]

Packt Apache Kafka Series Learn Apache Kafka for Beginners-XQZT

24/06/2018 Learning for Life Leave a Comment

Packt Apache Kafka Series Learn Apache Kafka for Beginners-XQZT
English | Size: 3.87 GB
Category: Tutorial

Apache Kafka has become the leading data-streaming enterprise technology. Kafka is used in production by over 2000 companies like Netflix, Airbnb, Uber and LinkedIn. To learn Kafka easily, step-by-step, you have come to the right place! Apache Kafka and its ecosystem: In this section, we will learn about the Apache Kafka ecosystem, and see how some target architectures may look. This high-level section helps you to set context around Kafka! Apache Kafka Core concepts: In this section, we will learn about all the fundamental concepts of Kafka like topics, partitions, replication, brokers, producers, consumers, consumer groups, Zookeeper, delivery semantics, and more! Docker and Kafka Setup: In this section, we will learn how to install Docker on your machine and get started with Apache Kafka, in the simplest way possible. Apache Kafka Hands-on Practice: In this section, we will gain some practical experience by learning how the various command lines tool work, as well as how to use the Kafka Topics UI, and create your very first producer and consumer in Java. Code Examples – Libraries Integrations: In this section, we will learn about some more advanced code examples, and understand where to find the libraries to integrate with frameworks such as Spark, Spark Streaming, Akka Streams, Scala, Actors, Apache NiFi. Advanced Topic Configuration: In this section, we will understand the main configurations for your topics, learn about log compaction, and understand exactly what your partitions are made of! [Read more…]

Packt Introduction to Apache NiFi (Hortonworks DataFlow HDF 2 0)-XQZT

05/06/2018 Learning for Life Leave a Comment

Packt Introduction to Apache NiFi (Hortonworks DataFlow HDF 2 0)-XQZT
English | Size: 2.00 GB
Category: CBTs

Apache NiFi was initially used by the NSA so they could move data at scale and was then open sourced. Being such a hot technology, Onyara (the company behind it) was then acquired by Hortonworks, one of the main backers of the big data project Hadoop, and then Hadoop Data Platform. Apache NiFi is now used in many top organisations that want to harness the power of their fast data by sourcing and transferring information from and to their database and big data lakes. It is a key tool to learn for the analyst and data scientists alike. Its simplicity and drag and drop interface make it a breeze to use! You can start building flows between Kafka and ElasticSearch, an FT,P and MongoDB, and so much more! Your imagination is the limit This course will take you through the Apache NiFi technology. It will help you understand its fundamental concepts, with theory lessons that walk you through the core concepts of Apache NiFi. You will also have hands-on labs to get started and build your first data flows. You will learn how to set up your connectors, processors, and how to read your FlowFiles to make the most of what NiFi has to offer. The most important configuration options will be demonstrated so you will be able to get started in no time. We will also analyse a template picked from the web and understand how to debug your flows as well as route your data to different processors based on outcomes through relationships. We will finally learn about the integrations between NiFi and Apache Kafka or MongoDB. Lots of learning ahead! [Read more…]

Docker, Apache Mesos & DCOS Run and manage cloud datacenter

21/05/2018 Learning for Life Leave a Comment

Docker, Apache Mesos & DCOS Run and manage cloud datacenter
English | Size: 1.23 GB
Category: CBTs

Docker is open source engine that can help you automate the deployment of applications inside software containers. Is was released in March 2013 and has been gaining popularity ever since. It has over 100 million downloads, and over 75000 applications are running as dockerized applications – that is a LOT! Apache Mesos is an open source cluster manager that provides efficient resource isolation and sharing across distributed applications or frameworks. Mesosphere DC/OS is an enterprise-grade datacenter-scale operating system, providing a single platform for running containers, big data, and distributed apps in production. DC/OS is built on the Apache Mesos core and provides newer technology including the native container-orchestration, Marathon application platform, intuitive user interfaces and much more. Knowledge and experience about Docker, Apache Mesos, and DC/OS could be very valuable for your career. [Read more…]

Lynda – Apache Spark Essential Training – Big Data Engineering

16/09/2017 Learning for Life Leave a Comment

Lynda – Apache Spark Essential Training – Big Data Engineering
English | Size: 368.79 MB
Category: Tutorial

In order to construct data pipelines and networks that stream, process, and store data, data engineers and data-science DevOps specialists must understand how to combine multiple big data technologies. In this course, discover how to build big data pipelines around Apache Spark. Join Kumaran Ponnambalam as he takes you through how to make Apache Spark work with other big data technologies. He covers the basics of Apache Kafka Connect and how to integrate it with Spark for real-time streaming. In addition, he demonstrates how to use the various technologies to construct an end-to-end project that solves a real-world business problem. [Read more…]