NiFi. HDP pre-configuration guide

• Install NiFi on HDP 3.0

  • Login to container

    • ssh root@localhost -p 2222

    • docker exec -it sandbox-hdp bash

    • other

  • Install hdf mpack

    ambari-server install-mpack --mpack=http://public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.4.1.1/tars/hdf_ambari_mp/hdf-ambari-mpack-3.4.1.1-4.tar.gz
    ambari-server restart

  • Go to Ambari admin page -> Stack and Versions -> Add NiFi service (make your passwords with 12 characters)

  • Add proxy configuration

    In case using VirtualBox on top of Windows, docker with hdp is run in virtual machine. Therefore you get access to the "host" machine via these credentials:

    • root@localhost

    • pass: hadoop

    • port: 2200

    • Go to {HDP_DOCKER_INSTALATION_FOLDER}/sandbox/proxy/conf.d

    • Edit file http-hdp.conf, add entry

      server {
      listen 9090;
      server_name sandbox-hdp.hortonworks.com;
      location / {
        proxy_pass http://sandbox-hdp-security:9090;
      }
      }

      NB! proxy_pass can be different. See previous entries in the file.

  • Restart sandbox-proxy container ( docker restart sandbox-proxy)

• Prepare HDFS for tutorial.

  • Create folder “sandbox” run next commands :

    su hdfs
    hdfs dfs -mkdir /sandbox
    hdfs dfs -chmod 777 /sandbox
    check if all correct with hdfs dfs -ls /