Zookeeper & Kafka - Single node and multiple brokersĪpache Hadoop Tutorial I with CDH - OverviewĪpache Hadoop Tutorial II with CDH - MapReduce Word CountĪpache Hadoop Tutorial III with CDH - MapReduce Word Count 2Īpache Hive 2.1.0 install on Ubuntu 16.04Īpache Hadoop : HBase in Pseudo-Distributed modeĪpache Hadoop : Creating HBase table with HBase shell and HUEĪpache Hadoop : Hue 3.11 install on Ubuntu 16. Zookeeper & Kafka - single node single broker This way, you will be able to download and use multiple Spark versions. Select the latest Spark release, a prebuilt package for Hadoop, and download it directly. QuickStart VMs for CDH 5.3 II - Hive DB query Install pySpark To install Spark, make sure you have Java 8 or higher installed on your computer. QuickStart VMs for CDH 5.3 II - Testing with wordcount Hadoop 2.6.5 - Installing on Ubuntu 16.04 (Single-Node Cluster)ĬDH5.3 Install on four EC2 instances (1 Name node and 3 Datanodes) using Cloudera Manager 5 Hadoop 2.6 - Installing on Ubuntu 14.04 (Single-Node Cluster) $ bin/ kafka-console-consumer.sh -zookeeper localhost:2181 -topic testing -from-beginning Now, use consumer command to retrieve messages on Apache Kafka Topic called "testing" by running the following command, and we should see the messages we typed in earlier played back to us: Note: Beginning with EEP 6.2.0, the configure.sh script creates the /apps/spark directory automatically. hadoop fs -mkdir /apps/spark hadoop fs -chmod 777 /apps/spark. $ bin/ kafka-console-producer.sh -broker-list localhost:9092 -topic testingĪfter running above command, enter some messages like "Spooky action at a distance?" press enter, then enter another message like "Quantum entanglement": Create the /apps/spark directory on the cluster filesystem, and set the correct permissions on the directory. Now, publish a sample messages to Apache Kafka topic called testing by using the following producer command: UN 127.0.0.1 102.68 KiB 256 100.0% 726f8c94-dc2a-428f-8070-1b6bcb99ebf5 rack1Ĭonnect to Cassandra cluster using its command line interface cqlsh ( Cassandra Query Language shell):Ĭonnection error: ('Unable to connect to any servers', Address Load Tokens Owns (effective) Host ID Rack $ gpg -export -armor 749D6EEC0353B12C | sudo apt-key add. $ gpg -keyserver -recv-keys 749D6EEC0353B12C
$ echo "deb 36x main" | sudo tee -a /etc/apt//cassandra.list
0 kommentar(er)
