Apache Kafka

• Overview
• Introduction to Kafka
  • Events and event streaming
  • Use cases
  • Terminology
    • Brokers
    • Topics
    • Producers
    • Consumers
    • Partitions
    • Replication
  • Components
    • Kafka Connect
    • Kafka Streams
  • Learn more
• Get Started with Kafka
  • Quick start options
  • Related content
• Kafka APIs
  • Producer API
  • Consumer API
  • Admin Client API
  • Connect API
  • Kafka Streams API
    • Kafka Streams DSL
    • Processor API
  • Related content
• Kafka Design
  • Design Overview
    • Topics in this section
    • Learn more
  • Kafka and the File System
    • Kafka and the JVM
    • Persistent queue and constant time
  • Batch Processing for Efficiency
    • Avoids excessive byte copying
    • Batches I/O operations
    • End-to-end batch compression
  • Producer Design
    • Producer load balancing
    • Batching
    • Additional reading
  • Consumer Design
    • Push versus pull design
    • Consumer groups, group IDs and coordinators
    • Tracking consumer position
    • Consumer offsets
    • Consumer position illustrated
    • Related content
  • Message Delivery Guarantees
    • Producer delivery
    • Consumer receipt
    • Exactly once support
    • Learn more
  • Replication
    • In-sync replicas and producer acks
    • Replicated logs: quorums, ISRs, and state machines
    • Unclean leader election and partition loss
    • Replica management
  • Log Compaction
    • Retention example
    • Compaction in action
      • Compaction enables deletes
      • View of compaction
      • Topic compaction video
    • Compaction guarantees
    • Configure compaction
  • Quotas
    • Why are quotas necessary?
    • Client groups
    • Quota configuration
    • Network bandwidth quotas
    • Request rate quotas
    • Enforcement
• Kafka Tools and Operations
  • Kafka Command-Line Interface (CLI) Tools
    • Search by tool name
    • Manage Kafka and configure metadata
      • kafka-server-start.sh
      • kafka-server-stop.sh
      • zookeeper-server-start.sh
      • zookeeper-server-stop.sh
      • kafka-storage.sh
      • kafka-cluster.sh
      • zookeeper-shell.sh
      • kafka-features.sh
      • kafka-broker-api-versions.sh
      • kafka-metadata-quorum.sh
      • kafka-metadata-shell.sh
      • kafka-configs.sh
      • zookeeper-security-migration.sh
    • Manage topics, partitions, and replication
      • kafka-topics.sh
      • kafka-configs.sh
      • kafka-get-offsets.sh
      • kafka-leader-election.sh
      • kafka-transactions.sh
      • kafka-reassign-partitions.sh
      • kafka-delete-records.sh
      • kafka-log-dirs.sh
      • kafka-replica-verification.sh
      • kafka-mirror-maker.sh
      • connect-mirror-maker.sh
    • Client, producer, and consumer tools
      • kafka-client-metrics.sh
      • kafka-verifiable-consumer.sh
      • kafka-configs.sh
      • kafka-verifiable-producer.sh
      • kafka-console-consumer.sh
      • kafka-console-producer.sh
      • kafka-producer-perf-test.sh
      • kafka-consumer-groups.sh
      • kafka-consumer-perf-test.sh
    • Manage Kafka Connect
      • connect-distributed.sh
      • connect-standalone.sh
      • connect-mirror-maker.sh
    • Manage Kafka Streams
      • kafka-streams-application-reset.sh
    • Manage security
      • kafka-acls
      • kafka-delegation-tokens.sh
      • zookeeper-security-migration.sh
    • Test and troubleshoot
      • kafka-e2e-latency.sh
      • kafka-dump-log.sh
      • kafka-jmx.sh
      • trogdor.sh
      • kafka-run-class.sh
  • Topic Operations
    • Add a topic
    • Describe a topic
    • Change the retention value for a topic
    • Increase partitions for a topic
    • Delete a topic
  • Choose and Change Partition Count
    • Partition formula
    • Partitions and message keys
    • Change the number of partitions
  • How to Use Kafka Tools With Confluent Cloud
    • Create a configuration file
    • Call the tool
    • Related content
  • View Consumer Group Info
    • Check consumer position
    • List groups and view offsets
    • Related content