Consuming messages on Kafka topic from the command line.

How to install kafka on RHEL 8

Apache Kafka is a distributed streaming platform. With it’s rich API (Application Programming Interface) set, we can connect mostly anything to Kafka as source of data, and on the other end, we can set up a large number of consumers that will receive the steam of records for processing. Kafka is highly scaleable, and stores the streams of data in a reliable and fault-tolerant way. From the connectivity perspective, Kafka can serve as a bridge between many heterogeneous systems, which in turn can rely on it’s capabilities to transfer and persist the data provided.

In this tutorial we will install Apache Kafka on a Red Hat Enterprise Linux 8, create the systemd unit files for ease of management, and test the functionality with the shipped command line tools.

In this tutorial you will learn:

  • How to install Apache Kafka
  • How to create systemd services for Kafka and Zookeeper
  • How to test Kafka with command line clients

Read more

Ansible Architecture

How to install and configure Ansible on Redhat Enterprise Linux 8

This tutorial covers step by step installation and configuration of Ansible on Redhat Enterprise Linux 8.
Ansible is the leading Open Source configuration management system. It makes it easy for administrators and operations teams to control thousands of servers from central machine without installing agents on them.

In this tutorial you will learn:

  • Ansible Overview
  • Install and Configure Python
  • Set Password-less SSH
  • Install Ansible
  • Testing and Managing the Ansible

Read more

Zookeeper Architectural Overview

How to install and configure Zookeeper in Ubuntu 18.04

Zookeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.
All of these kinds of services are used in some form or another by distributed applications.

In this article, we have explained the necessary steps to install and configure 3 Node Zookeeper Cluster with a definite quorum on Ubuntu 18.04.

In this tutorial you will learn:

  • What is Zookeeper and its Overview.
  • What is the Architecture of Zookeeper.
  • How to Configure the Zookeeper hosts and Add Zookeeper User.
  • How to Install and Configure Oracle JDK.
  • How to Configure and Setup the Zookeeper.
  • How to Configure Worker Nodes to join the Swarm Cluster.
  • How to Verify the Zookeeper Cluster and Ensemble.

Read more

Docker Swarm Services

How to Configure Docker Swarm with multiple Docker Nodes on Ubuntu 18.04

Docker Swarm is a container orchestration and clustering tool to manage Docker hosts, and is a part of Docker Engine. It’s a native clustering tool provided by Docker which provides high-availability and high-performance for your application.

The primary objective of Docker Swarm is to group multiple Docker hosts into a single logical virtual server—this ensures availability and high performance for your application by distributing it over a number of Docker hosts instead of just one.

In this tutorial you will learn:

  • What is Docker Swarm
  • How to Configure Hosts
  • How to Install and Run Docker Service
  • How to Configure the Manager Node for Swarm Cluster Initialization
  • How to Configure Worker Nodes to join the Swarm Cluster
  • How to Verify the Swarm Cluster
  • How to Deploy new Service on Swarm Cluster

Read more

Running Ubuntu 18.04 on Windows 10

How to install Ubuntu 18.04 on Windows 10

This tutorial will guide you step by step though the installation of Ubuntu 18.04 on the Windows 10 operating system. The Ubuntu 18.04 system is available as an application via Microsoft Store.

In this How to install Ubuntu 18.04 on Windows 10 tutorial you will learn:

  • How to run PowerShell as an Administrator.
  • How to enable the Windows subsystem for Linux component.
  • How to find Ubuntu 18.04 app in Microsoft Store.
  • How to launch Ubuntu 18.04 on Windows 10.
  • How to create an initial user on Ubuntu 18.04 running on Windows 10.

Read more

Namenode Web User Interface

How to install Hadoop on Ubuntu 18.04 Bionic Beaver Linux

Apache Hadoop is an open source framework used for distributed storage as well as distributed processing of big data on clusters of computers which runs on commodity hardwares. Hadoop stores data in Hadoop Distributed File System (HDFS) and the processing of these data is done using MapReduce. YARN provides API for requesting and allocating resource in the Hadoop cluster.

The Apache Hadoop framework is composed of the following modules:

  • Hadoop Common
  • Hadoop Distributed File System (HDFS)
  • YARN
  • MapReduce

This article explains how to install Hadoop Version 2 on Ubuntu 18.04. We will install HDFS (Namenode and Datanode), YARN, MapReduce on the single node cluster in Pseudo Distributed Mode which is distributed simulation on a single machine. Each Hadoop daemon such as hdfs, yarn, mapreduce etc. will run as a separate/individual java process.

In this tutorial you will learn:

  • How to add users for Hadoop Environment
  • How to install and configure the Oracle JDK
  • How to configure passwordless SSH
  • How to install Hadoop and configure necessary related xml files
  • How to start the Hadoop Cluster
  • How to access NameNode and ResourceManager Web UI

Read more

Install Open JDK java on Ubuntu 18.10 Cosmic Cuttlefish

How to install Java on Ubuntu 18.10 Cosmic Cuttlefish Linux

Objective

The objective of this tutorial is to install Java on Ubuntu 18.10 Cosmic Cuttlefish Linux.

Operating System and Software Versions

  • Operating System: – Ubuntu 18.10 Cosmic Cuttlefish
  • Software: – Java(TM) SE Runtime Environment 8,10 or 11

Requirements

Privileged access to to your Ubuntu 18.10 Cosmic Cuttlefish Linux system is required to perform this installation.

Difficulty

EASY

Conventions

Read more

FreeIPA login page

How to install and configure FreeIPA on Red Hat Linux

Objective

Our objective is to install and configure a standalone FreeIPA server on Red Hat Enterprise Linux.

Operating System and Software Versions

  • Operating System: Red Hat Enterprise Linux 7.5
  • Software: FreeIPA 4.5.4-10

Requirements

Privileged access to the target server, available software repository.

Difficulty

MEDIUM

Conventions

  • # – requires given linux commands to be executed with root privileges either directly as a root user or by use of sudo command
  • $ – given linux commands to be executed as a regular non-privileged user

Introduction

FreeIPA is mainly a directory service, where you can store information about your users, and their rights regarding login, become root, or just run a specific command as root on your systems that are joined your FreeIPA domain, and many more. Although this is the main feature of the service, there are optional components that can be very useful, like DNS and PKI – this makes FreeIPA an essential infrastructural part of a Linux-based system. It has a nice web-based GUI, and powerful command line interface.

Read more

Image showing a Puppet sync error message

How to use Puppet environments in Linux to safely update an agent

Objective

Create and use puppet environments to test new configuration before updating a live production system.

Operating System and Software Versions

  • Operating System: Any major linux distribution e.g. Ubuntu, Debian, CentOS
  • Software: puppet and puppet-master

Requirements

Privileged access to the puppet master server and the puppet client node.

Conventions

  • # – requires given linux commands to be executed with root privileges either directly as a root user or by use of sudo command
  • $ – given linux commands to be executed as a regular non-privileged user

Introduction

Most Puppet installations begin life as a master server running a single branch. The master contains all the manifests and other configuration for all the Puppet agents that are synced to it. This is a fine place to begin but there will rapidly arrive a time when an update needs pushing that has the potential to break a production server. Hoping for the best is not the best way to proceed.

Puppet provides the tools to separate entire branches of configuration. These are called environments. A Puppet environment is a way to supply an isolated group of agent nodes with their own dedicated configuration. Each environment contains an entire Puppet configuration tree and can be considered as a separate Puppet master server.

Read more