BD201Notes
  • Notes
  • Structure
  • Links
  • Topics for writiing task
    • HDFS
    • YARN
    • Hive
    • Kafka
    • Spark
    • ELK
  • Questions
    • Questions with answers
      • 2. HDFS
      • 3. DEVOPS
      • 4. HIVE
      • 7. STREAMING
      • 8. Elastic
    • Questions for screanings
      • junior
  • DevOps
    • DevOps: Practices
    • DevOps: Responsibilities in a Cloud
    • DevOps: CI/CD
    • DevOps: Tools. Docker
    • DevOps: Tools. Jenkins
    • DevOps: Tools. Puppet
    • DevOps: Tools. Ansible
    • DevOps: Tools. Kubernetes
  • Introduction To Big Data
    • Value of Data
    • Types of Data (Structured and Unstructured)
    • Schema on read & schema on write
    • Speed of data – from real time to batched processing
    • Storage & formats of data & compression
  • Hadoop Core
    • Hadoop Ecosystem
    • Hadoop Architecture
    • YARN
      • YARN: Logical and physical projections
      • YARN: Scheduler
      • YARN: Exec Modes
      • YARN: Security
    • MAP REDUCE
      • MAP REDUCE: Hints
  • Data Flow
    • NiFi
      • NiFi. HDP pre-configuration guide
      • StreamSets
  • Spark
    • Links
  • ELK
    • Elasticsearch
      • Elasticsearch: Installation and Configuration
    • Kibana
      • Kibana: Installation
    • Logstash
    • Beats
  • Orchestration & Scheduling
    • Apache Airflow
      • Airflow: Notes
Powered by GitBook
On this page

Was this helpful?

  1. Topics for writiing task

Hive

  • Hive components and their role (Driver, Compiler, Metastore, Execute Engine, Optimizer)

  • Shema on read vs Shema on write

  • Metastore

  • Beeline versus Hive CLI

  • Partitions and Buckets

  • View vs Temporary table

  • Engine Compare (TEZ vs MR vs Spark)

  • UDF (description; classification; ObjectInspector; Python?)

  • SQL vs HQL

  • ACID Hive? requrements.

  • Vectorization

  • CBO

PreviousYARNNextKafka

Last updated 5 years ago

Was this helpful?