BD201Notes
  • Notes
  • Structure
  • Links
  • Topics for writiing task
    • HDFS
    • YARN
    • Hive
    • Kafka
    • Spark
    • ELK
  • Questions
    • Questions with answers
      • 2. HDFS
      • 3. DEVOPS
      • 4. HIVE
      • 7. STREAMING
      • 8. Elastic
    • Questions for screanings
      • junior
  • DevOps
    • DevOps: Practices
    • DevOps: Responsibilities in a Cloud
    • DevOps: CI/CD
    • DevOps: Tools. Docker
    • DevOps: Tools. Jenkins
    • DevOps: Tools. Puppet
    • DevOps: Tools. Ansible
    • DevOps: Tools. Kubernetes
  • Introduction To Big Data
    • Value of Data
    • Types of Data (Structured and Unstructured)
    • Schema on read & schema on write
    • Speed of data – from real time to batched processing
    • Storage & formats of data & compression
  • Hadoop Core
    • Hadoop Ecosystem
    • Hadoop Architecture
    • YARN
      • YARN: Logical and physical projections
      • YARN: Scheduler
      • YARN: Exec Modes
      • YARN: Security
    • MAP REDUCE
      • MAP REDUCE: Hints
  • Data Flow
    • NiFi
      • NiFi. HDP pre-configuration guide
      • StreamSets
  • Spark
    • Links
  • ELK
    • Elasticsearch
      • Elasticsearch: Installation and Configuration
    • Kibana
      • Kibana: Installation
    • Logstash
    • Beats
  • Orchestration & Scheduling
    • Apache Airflow
      • Airflow: Notes
Powered by GitBook
On this page

Was this helpful?

  1. Topics for writiing task

HDFS

  • HDFS node types. What is the purpose of each of them?

  • How HDFS achieves Fault Tolerance?

  • Block size. Physical space allocation of blocks.

  • Small files problem. Small file problem solutions

  • What is rack and rack awareness? Data locality.

  • How does name node mange meta data fsimage; editlogs, SecondaryNameNode

  • Describe High Availability

  • What are differences between CheckpointingNameNode and BackupNameNode?

  • Namespaces and Federation

  • Analyze the benefits and challenges of the HDFS architecture.

  • File Formats. Describe and compare these file formats: ORC, Sequence; Avro; JSON

  • HDFS VS S3 VS Azure Blob storage

  • HDFS regarding CAP theorem

PreviousTopics for writiing taskNextYARN

Last updated 4 years ago

Was this helpful?