# Tutorial: Using Kafka with Amazon S3

###### [Documentation](https://instaclustr.husldigital.com/support/documentation/)



 

 

 

###### [Documentation](https://instaclustr.husldigital.com/support/documentation/)

- [ Announcements+ ](#section-announcements)
    - [ General ](#section-announcements-general)
        - [ Announcement: RIYOA is now BYOC, and RICMI is now On-Premises ](https://instaclustr.husldigital.com/support/documentation/announcements/general/announcement-riyoa-is-now-byoc-and-ricmi-is-now-on-premises/)
        - [ Self-Service Tag Management feature is now available on the NetApp Instaclustr Managed Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/general/self-service-tag-management-feature-is-now-available-on-the-netapp-instaclustr-managed-platform/)
        - [ NetApp releases Public Preview of Zero Inbound Access on the NetApp Instaclustr Managed Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/general/instaclustr-releases-zero-inbound-access-public-preview/)
        - [ Instaclustr enables Default Encryption for new AWS EBS Volumes ](https://instaclustr.husldigital.com/support/documentation/announcements/general/instaclustr-enables-default-encryption-for-new-aws-ebs-volumes/)
        - [ Instaclustr API Rate Limits ](https://instaclustr.husldigital.com/support/documentation/announcements/general/instaclustr-api-rate-limits/)
        - [ Instaclustr disables GCP Soft-Delete on Cloud Storage Buckets ](https://instaclustr.husldigital.com/support/documentation/announcements/general/instaclustr-disables-gcp-soft-delete-on-cloud-storage-buckets/)
    - [ Apache Cassandra ](#section-announcements-apache-cassandra)
        - [ Announcement: Addressing Assertion Errors and Quorum Failures in Cassandra 5.x Versions ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-cassandra/announcement-addressing-assertion-errors-and-quorum-failures-in-cassandra-5-x-versions/)
        - [ Addressing Mutation Thread Stalls in Cassandra 4.1.8 ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-cassandra/addressing-mutation-thread-stalls-in-cassandra-4-1-8/)
        - [ Important Announcement Regarding Cassandra 3.x End-of-Life Support ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-cassandra/cassandra-3-eol/)
        - [ Updates to Cipher Suites for Cassandra version 4 and above Clusters ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-cassandra/updates-to-cipher-suites-for-cassandra-version-4-and-above-clusters/)
        - [ Important Update: Apache Spark™ Add-On Will Reach End of Life on Instaclustr Platform on 10 Aug 2025 ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-cassandra/important-update-apache-spark-add-on-will-reach-end-of-life-on-instaclustr-platform-on-10-aug-2025/)
        - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-cassandra/past-announcements/)
    - [ Apache Kafka and Kafka Connect ](#section-announcements-apache-kafka-and-kafka-connect)
        - [ How to monitor Kafka consumer group lag with Client Telemetry ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/how-to-monitor-kafka-consumer-group-lag-with-client-telemetry/)
        - [ Identifying when a Kafka share group is falling behind ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/identifying-when-a-kafka-share-group-is-falling-behind/)
        - [ Kafka client fleet visibility and per-producer latency with Client Telemetry ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/kafka-client-fleet-visibility-and-per-producer-latency-with-client-telemetry/)
        - [ Instaclustr for Apache Kafka® and Kafka® Connect 4.3.1 are now generally available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/instaclustr-for-apache-kafka-and-kafka-connect-4-3-1-are-now-generally-available/)
        - [ Instaclustr for Apache Kafka® and Kafka® Connect 4.2.1 are now generally available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/instaclustr-for-apache-kafka-and-kafka-connect-4-2-1-are-now-generally-available/)
        - [ Instaclustr for Apache Kafka® and Apache Kafka® Connect 4.1.2 Are Generally Available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/instaclustr-for-apache-kafka-and-apache-kafka-connect-4-1-2-are-generally-available/)
        - [ Instaclustr for Apache Kafka® and Apache Kafka® Connect 3.9.2 are Generally Available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/instaclustr-for-apache-kafka-and-apache-kafka-connect-3-9-2-are-generally-available/)
        - [ Kafka “Diskless” – Proposals, Status &amp; Insights ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/kafka-diskless-proposals-status-insights/)
        - [ Past Announcements ](#section-announcements-apache-kafka-and-kafka-connect-past-announcements)
            - [ Instaclustr for Apache Kafka® and Kafka ® Connect 4.1.1 are generally available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/past-announcements/instaclustr-for-apache-kafka-and-kafka-connect-4-1-1-are-generally-available/)
            - [ NetApp Instaclustr Security Advisory – Multiple Kafka CVEs (June 2025) ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/past-announcements/netapp-instaclustr-security-advisory-multiple-kafka-cves-june-2025/)
            - [ Instaclustr for Apache Kafka® and Kafka ® Connect 3.9.1 are generally available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/past-announcements/instaclustr-for-apache-kafka-and-kafka-connect-3-9-1-are-generally-available/)
            - [ Instaclustr for Apache Kafka® and Apache Kafka® Connect 3.9.0 Are Generally Available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/past-announcements/instaclustr-for-apache-kafka-and-kafka-connect-3-9-0-are-generally-available/)
            - [ Instaclustr for Apache Kafka® 3.8.1 and Kafka Tiered Storage Are Now Generally Available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/past-announcements/instaclustr-for-apache-kafka-3-8-1-and-kafka-tiered-storage-are-now-generally-available/)
            - [ Instaclustr for Apache Kafka® and Apache Kafka® Connect 3.7.1 Are Now Generally Available ](https://instaclustr.husldigital.com/support/documentation/announcements/apache-kafka-and-kafka-connect/past-announcements/instaclustr-for-apache-kafka-and-apache-kafka-connect-3-7-1-are-now-generally-available/)
    - [ Cadence ](#section-announcements-cadence)
        - [ Instaclustr NetApp Announces AWS Graviton Node Types for Managed Cadence® Workflow ](https://instaclustr.husldigital.com/support/documentation/announcements/cadence/instaclustr-netapp-announces-aws-graviton-node-types-for-managed-cadence-workflow/)
        - [ NetApp Announces General Availability of Cadence Web 4.0 and Cadence version 1.3.2 on the NetApp Instaclustr Managed Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/cadence/netapp-announces-general-availability-of-cadence-web-4-0-and-cadence-version-1-3-2-on-the-netapp-instaclustr-managed-platform/)
        - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/cadence/past-announcements/)
    - [ ClickHouse ](#section-announcements-clickhouse)
        - [ Simpler, secure peering with AWS PrivateLink with NetApp Instaclustr for ClickHouse on the NetApp Instaclustr managed platform ](https://instaclustr.husldigital.com/support/documentation/announcements/clickhouse/aws-privatelink-clickhouse/)
    - [ OpenSearch ](#section-announcements-opensearch)
        - [ OpenSearch 3.5 Is Now Generally Available on the NetApp Instaclustr Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/opensearch/opensearch-3-5-generally-available-netapp-instaclustr-platform/)
        - [ Observability Plugin Is Now Available for OpenSearch on the NetApp Instaclustr Managed Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/opensearch/observability-plugin-available-for-opensearch-on-the-netapp-instaclustr-managed-platform/)
        - [ Announcing OpenSearch 2.18 on the Instaclustr Managed Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/opensearch/announcing-opensearch-2-18-on-the-instaclustr-managed-platform/)
        - [ OpenSearch® Sink Connector for Apache Kafka® is now Available on the Instaclustr Managed Platform ](https://instaclustr.husldigital.com/support/documentation/announcements/opensearch/opensearch-sink-connector-for-apache-kafka-is-now-available-on-the-instaclustr-managed-platform/)
        - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/opensearch/past-announcements/)
    - [ PostgreSQL ](#section-announcements-postgresql-2)
        - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/postgresql-2/past-announcements/)
    - [ Release Log ](https://instaclustr.husldigital.com/support/documentation/announcements/release-log/)
    - [ Archive ](#section-announcements-archive)
        - [ Apache ZooKeeper ](#section-announcements-archive-apache-zookeeper)
            - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/archive/apache-zookeeper/past-announcements-2/)
        - [ Redis ](#section-announcements-archive-redis)
            - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/archive/redis/past-announcements/)
        - [ Valkey ](#section-announcements-archive-valkey)
            - [ Past Announcements ](https://instaclustr.husldigital.com/support/documentation/announcements/archive/valkey/past-announcements/)
- [ Getting Started+ ](#section-getting-started)
    - [ Signing Up ](https://instaclustr.husldigital.com/support/documentation/getting-started/signing-up/)
    - [ AWS Marketplace ](https://instaclustr.husldigital.com/support/documentation/getting-started/aws-marketplace/)
    - [ Azure Marketplace ](https://instaclustr.husldigital.com/support/documentation/getting-started/azure-marketplace/)
    - [ GCP Marketplace ](https://instaclustr.husldigital.com/support/documentation/getting-started/gcp-marketplace/)
    - [ Set Up BYOC - AWS ](https://instaclustr.husldigital.com/support/documentation/getting-started/set-up-byoc-aws/)
    - [ Setting Up a BYOC Provider Account Using Terraform ](https://instaclustr.husldigital.com/support/documentation/getting-started/setting-up-a-byoc-provider-account-using-terraform/)
- [ Instaclustr Account and User Management+ ](#section-instaclustr-account-and-user-management)
    - [ Updating User Details ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/updating-user-details/)
    - [ Migrating to Social SSO ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/migrating-to-social-sso/)
    - [ Change a User's Sign In Option ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/change-a-users-sign-in-option/)
    - [ User Security Settings ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/user-security-settings/)
    - [ Enable 2-Factor Authentication on Your User ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/enable-2-factor-authentication/)
    - [ Managing Account Details and Access ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/managing-account-details-and-access/)
    - [ Restructuring Accounts and Clusters via Instaclustr Organizations ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/restructuring-accounts-and-clusters-via-instaclustr-organizations/)
    - [ Types of Instaclustr Support Contacts ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/types-of-support-contact/)
    - [ Setting Account Preferences for Maintenance Event Notifications ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/setting-account-preferences-for-maintenance-event-notifications/)
    - [ Maintenance Event Webhook Notifications ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/maintenance-event-webhook-notifications/)
    - [ Account Security Options ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/account-security-options/)
    - [ Single Sign On (SSO) with SAML 2.0 Authentication ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/single-sign-on/)
    - [ Add New User to Your Account ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/add-new-user-account/)
    - [ User Roles ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/user-roles/)
    - [ Service Users ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/service-users/)
    - [ Organization Management ](#section-instaclustr-account-and-user-management-organization-management)
        - [ Create a New Organization ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/create-a-new-organization/)
        - [ Migrate Clusters to another Account within an Organization ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/migrate-clusters-to-another-account-within-an-organization/)
        - [ Enrol and Remove Accounts from an Organization ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/enrol-and-remove-accounts-from-an-organization/)
        - [ Manage Organization Owners ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/manage-organization-owners/)
        - [ Manage Organization Details ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/manage-organization-details/)
        - [ Manage Billing Through the Organization ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/manage-billing-through-the-organization/)
        - [ Manage Multiple Account SSO through the Organization ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/manage-multiple-account-sso-through-the-organization/)
        - [ Organization Account Controls ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/account-controls/)
        - [ Sharing BYOC Provider Accounts ](https://instaclustr.husldigital.com/support/documentation/instaclustr-account-and-user-management/organization-management/sharing-byoc-provider-accounts/)
- [ Console Features+ ](#section-console-features)
    - [ Using Service Control Policies with Instaclustr BYOC (previously RIYOA) ](https://instaclustr.husldigital.com/support/documentation/console-features/using-service-control-policies-with-instaclustr-byoc/)
    - [ The Monitoring Page ](https://instaclustr.husldigital.com/support/documentation/console-features/the-monitoring-page/)
    - [ Search in Instaclustr Console ](https://instaclustr.husldigital.com/support/documentation/console-features/search-clusters-and-accounts/)
    - [ API Keys ](https://instaclustr.husldigital.com/support/documentation/console-features/api-keys/)
    - [ Adding Tags to Clusters ](https://instaclustr.husldigital.com/support/documentation/console-features/adding-tags-to-clusters/)
    - [ Deleting a Cluster ](https://instaclustr.husldigital.com/support/documentation/console-features/deleting-a-cluster/)
    - [ Two-Factor Delete ](https://instaclustr.husldigital.com/support/documentation/console-features/two-factor-delete/)
    - [ Maintenance Scheduling Features ](#section-console-features-maintenance-scheduling-features)
        - [ Maintenance Events ](https://instaclustr.husldigital.com/support/documentation/console-features/maintenance-scheduling-features/maintenance-events/)
        - [ Exclusion Times ](https://instaclustr.husldigital.com/support/documentation/console-features/maintenance-scheduling-features/exclusion-times/)
    - [ Instaclustr Application Logs ](#section-console-features-application-logs)
        - [ Viewing Application Logs ](https://instaclustr.husldigital.com/support/documentation/console-features/application-logs/viewing-logs/)
        - [ Storing Application Logs in S3 ](https://instaclustr.husldigital.com/support/documentation/console-features/application-logs/storing-application-logs-in-s3/)
        - [ Sending Application Logs to Apache Kafka® ](https://instaclustr.husldigital.com/support/documentation/console-features/application-logs/sending-application-logs-to-apache-kafka/)
    - [ Management Units Usage ](https://instaclustr.husldigital.com/support/documentation/console-features/management-units-usage/)
- [ Useful Information+ ](#section-useful-information)
    - [ Maximizing Availability During Maintenance on the NetApp Instaclustr Platform ](https://instaclustr.husldigital.com/support/documentation/useful-information/maximizing-availability-during-maintenance-on-the-netapp-instaclustr-platform/)
    - [ Self-Service Tag Management ](https://instaclustr.husldigital.com/support/documentation/useful-information/self-service-tag-management/)
    - [ Single CA ](https://instaclustr.husldigital.com/support/documentation/useful-information/single-ca/)
    - [ Zero Inbound Access ](https://instaclustr.husldigital.com/support/documentation/useful-information/zero-inbound-access/)
    - [ Cluster DNS ](https://instaclustr.husldigital.com/support/documentation/useful-information/cluster-dns/)
    - [ Lifecycle Policy ](https://instaclustr.husldigital.com/support/documentation/useful-information/lifecycle-policy/)
    - [ Lifecycle Status of Application Versions ](https://instaclustr.husldigital.com/support/documentation/useful-information/lifecycle-status-of-application-versions/)
    - [ Private Link ](#section-useful-information-private-link)
        - [ Azure Private Link ](https://instaclustr.husldigital.com/support/documentation/useful-information/private-link/azure-private-link/)
        - [ GCP Private Service Connect ](https://instaclustr.husldigital.com/support/documentation/useful-information/private-link/gcp-private-service-connect/)
        - [ AWS PrivateLink ](https://instaclustr.husldigital.com/support/documentation/useful-information/private-link/aws-privatelink/)
    - [ Subject Alternative Names ](https://instaclustr.husldigital.com/support/documentation/useful-information/subject-alternative-names/)
    - [ PCI Compliance ](https://instaclustr.husldigital.com/support/documentation/useful-information/pci-compliance/)
    - [ Regions Not Included in the Cloud Provider Compliance Report ](https://instaclustr.husldigital.com/support/documentation/useful-information/regions-not-in-cloud-provider-compliance-report/)
    - [ Private Network Clusters ](https://instaclustr.husldigital.com/support/documentation/useful-information/private-network-clusters/)
    - [ Unsupported Firewall Rules ](https://instaclustr.husldigital.com/support/documentation/useful-information/unsupported-firewall-rules/)
    - [ What Are Virtual Racks? ](https://instaclustr.husldigital.com/support/documentation/useful-information/what-are-virtual-racks/)
    - [ AWS EBS Encryption and KMS Keys ](#section-useful-information-aws-ebs-encryption-and-kms-keys)
        - [ Creating an AWS Data Centre with EBS Encryption ](https://instaclustr.husldigital.com/support/documentation/useful-information/aws-ebs-encryption-and-kms-keys/creating-an-aws-data-centre-with-ebs-encryption/)
        - [ Adding a KMS Key for Use on the Instaclustr Platform using Run in Instaclustr’s Account (RIIA) Provisioning ](https://instaclustr.husldigital.com/support/documentation/useful-information/aws-ebs-encryption-and-kms-keys/adding-a-kms-key-riia/)
        - [ Adding a KMS Key for use on the Instaclustr Platform using AWS Bring Your Own Cloud (BYOC - previously RIYOA) Provisioning ](https://instaclustr.husldigital.com/support/documentation/useful-information/aws-ebs-encryption-and-kms-keys/adding-a-kms-key-byoc/)
    - [ Network Address Allocation ](https://instaclustr.husldigital.com/support/documentation/useful-information/network-address-allocation/)
    - [ SLA Tier ](https://instaclustr.husldigital.com/support/documentation/useful-information/sla-tier/)
    - [ The Provisioning Life Cycle ](https://instaclustr.husldigital.com/support/documentation/useful-information/provisioning-lifecycle/)
    - [ Bundled Use Only Cluster Deployments ](https://instaclustr.husldigital.com/support/documentation/useful-information/bundled-use-only-cluster-deployments/)
    - [ Understanding Encryption on your ANF Cluster ](https://instaclustr.husldigital.com/support/documentation/useful-information/understanding-encryption-on-your-anf-cluster/)
    - [ BYOC Template Technical Reference ](https://instaclustr.husldigital.com/support/documentation/useful-information/byoc-template-technical-reference/)
    - [ Instaclustr Open Source Project Status ](https://instaclustr.husldigital.com/support/documentation/useful-information/instaclustr-open-source-project-status/)
- [ Security+ ](#section-security)
    - [ NetApp Instaclustr Security Overview ](https://instaclustr.husldigital.com/support/documentation/security/instaclustr-security-overview/)
    - [ Infrastructure &amp; Network Security ](https://instaclustr.husldigital.com/support/documentation/security/infrastructure-network-security/)
    - [ Data Protection ](https://instaclustr.husldigital.com/support/documentation/security/data-protection/)
    - [ Application Security ](https://instaclustr.husldigital.com/support/documentation/security/application-security/)
    - [ Trust and Access ](https://instaclustr.husldigital.com/support/documentation/security/trust-and-access/)
    - [ Resilience ](https://instaclustr.husldigital.com/support/documentation/security/resilience/)
    - [ AI Cluster Health Security Overview ](https://instaclustr.husldigital.com/support/documentation/security/ai-cluster-health-security-overview/)
    - [ Security Advisories ](#section-security-security-advisories)
        - [ Instaclustr Platform ](#section-security-security-advisories-instaclustr-platform)
            - [ Security Advisory: Linux kernel vulnerabilities that allow a local user to gain root through page-cache changes ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/instaclustr-platform/security-advisory-linux-kernel-vulnerabilities-that-allow-a-local-user-to-gain-root-through-page-cache-changes/)
            - [ NetApp Instaclustr Security Advisory - CVE-2024-48990 ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/instaclustr-platform/netapp-instaclustr-security-advisory-cve-2024-48990/)
        - [ Apache Cassandra ](#section-security-security-advisories-apache-cassandra)
            - [ Security Advisory – Cassandra Lucene Index – CVE-2025-26511 ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/apache-cassandra/security-advisory-cassandra-lucene-index-cve-2025-26511/)
            - [ Security Advisory for Apache Cassandra Vulnerabilities - CVE-2025-23015, CVE-2025-24860, and CVE-2024-27137 ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/apache-cassandra/security-advisory-for-apache-cassandra-vulnerabilities-cve-2025-23015-cve-2025-24860-and-cve-2024-27137/)
        - [ Apache Kafka and Kafka Connect ](#section-security-security-advisories-apache-kafka-and-kafka-connect)
            - [ NetApp Instaclustr Security Advisory – Multiple Kafka CVEs (June 2025) ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/apache-kafka-and-kafka-connect/netapp-instaclustr-security-advisory-multiple-kafka-cves-june-2025/)
        - [ PostgreSQL ](#section-security-security-advisories-postgresql)
            - [ NetApp Instaclustr Security Advisory – Multiple PostgreSQL CVEs (September 2026) ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/postgresql/netapp-instaclustr-security-advisory-multiple-postgresql-cves-september-2026/)
            - [ Security Advisory for PostgreSQL Vulnerability CVE 2024-7348 ](https://instaclustr.husldigital.com/support/documentation/security/security-advisories/postgresql/security-advisory-for-postgresql-vulnerability-cve-2024-7348/)
- [ Apache Cassandra+ ](#section-cassandra)
    - [ Getting Started with Apache Cassandra ](#section-cassandra-getting-started-with-cassandra)
        - [ Creating an Apache Cassandra Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra/getting-started-with-cassandra/creating-a-cluster/)
        - [ Creating a PCI Compliant Cassandra Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra/getting-started-with-cassandra/documentation-cassandra-getting-started-with-cassandra-creating-a-pci-compliant-cluster/)
        - [ Creating an AWS PrivateLink enabled Apache Cassandra Cluster on the Instaclustr Platform ](https://instaclustr.husldigital.com/support/documentation/cassandra/getting-started-with-cassandra/creating-a-privatelink-cassandra-cluster/)
        - [ Creating an Apache Cassandra Cluster in a Custom VPC ](https://instaclustr.husldigital.com/support/documentation/cassandra/getting-started-with-cassandra/custom-vpc/)
    - [ Using Apache Cassandra ](#section-cassandra-using-cassandra)
        - [ Apache Cassandra Support Caveats ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/apache-cassandra-support-caveats/)
        - [ Changing the Apache Cassandra default user password ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/changing-the-cassandra-default-user-password/)
        - [ Connect to an Apache Cassandra Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-a-cluster/)
        - [ Connect to Apache Cassandra with Cqlsh ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-cassandra-with-cqlsh/)
        - [ Connect to Apache Cassandra with C# ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-cassandra-with-c-sharp/)
        - [ Connect to Apache Cassandra with Golang ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-cassandra-with-golang/)
        - [ Connect to Apache Cassandra with Node.js ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-cassandra-with-node-js/)
        - [ Connect to an AWS PrivateLink enabled Apache Cassandra Cluster on the Instaclustr Platform ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-an-aws-privatelink-enabled-apache-cassandra-cluster-on-the-instaclustr-platform/)
        - [ Avoiding range slice issues in Cassandra ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/avoiding-range-slice-issues-in-cassandra/)
        - [ Managing Tombstones in Apache Cassandra ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/managing-tombstones-in-cassandra/)
        - [ Use VPC Peering (AWS) to Connect to Apache Cassandra | Instaclustr ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connect-to-cassandra-cluster-vpc-peering-aws/)
        - [ Use VPC Network Peering (GCP) to Connect to Apache Cassandra ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/use-vpc-network-peering-gcp-to-connect-to-cassandra/)
        - [ Use VNet Peering (Azure AZ) to Connect to Apache Cassandra ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/use-vnet-peering-azure-az-to-connect-to-apache-cassandra/)
        - [ Cluster data centre (CDC) &amp; private addressing (GCP) connection ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/connecting-to-a-cluster-data-center-cdc-with-private-addressing-gcp/)
        - [ Data Modelling Recommended Practices ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/data-modelling-recommended-practices/)
        - [ ic-tools for Apache Cassandra SSTables ](https://instaclustr.husldigital.com/support/documentation/cassandra/using-cassandra/ic-tools-for-cassandra-sstables/)
    - [ Apache Cassandra Cluster Operations ](#section-cassandra-cassandra-cluster-operations)
        - [ Expanding Your Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-cluster-operations/expanding-your-cluster/)
        - [ Setting Up a Multi-Datacentre Cluster with Instaclustr ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-cluster-operations/setting-up-a-multi-datacentre-cluster-with-instaclustr/)
        - [ Cluster Data Backups ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-cluster-operations/cluster-data-backups/)
        - [ Restoring a Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-cluster-operations/restoring-a-cluster/)
        - [ Apache Cassandra version upgrades ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-cluster-operations/cassandra-version-upgrades/)
        - [ In-place Data Centre Resizing ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-cluster-operations/in-place-data-centre-resizing/)
    - [ Apache Cassandra Monitoring Metrics Documentation ](#section-cassandra-cassandra-monitoring)
        - [ Monitoring API Metrics Troubleshooting ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/monitoring-api-metrics-troubleshooting/)
        - [ Accessing Monitoring Tools ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/accessing-monitoring-tools/)
        - [ Tombstones Per Read ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/tombstones-per-read/)
        - [ SSTables Per Read ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/sstables-per-read/)
        - [ Client Reads and Writes Latency ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/read-and-write-latency/)
        - [ Reads and Writes Per Second ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/reads-and-writes-per-second/)
        - [ Thread Pool Metrics ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/thread-pool-metrics/)
        - [ Pending Compactions ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/pending-compactions/)
        - [ Range Slice ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/range-slice/)
        - [ Synthetic Transactions ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/synthetic-transactions/)
        - [ OS Load - Apache Cassandra ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/os-load/)
        - [ Total Hint Metrics ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/total-hints/)
        - [ Partition Size ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/partition-size/)
        - [ Cluster Health Check ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/cluster-health-check/)
        - [ Request Latency ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/request-latency/)
        - [ Cassandra CPU Usage ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/cpu-usage/)
        - [ Disk Usage ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/disk-usage/)
        - [ Network ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/network/)
        - [ Additional CPU ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/additional-cpu/)
        - [ Memory ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/memory/)
        - [ Memory (Heap) ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/heap-memory/)
        - [ Memory (Off-Heap) ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/off-heap-memory/)
        - [ Client Connections ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/client-connections/)
        - [ Garbage Collection (ParNew) ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/garbage-collection-parnew/)
        - [ Active Schema Versions ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/active-schema-versions/)
        - [ CAS Reads and CAS Writes ](https://instaclustr.husldigital.com/support/documentation/cassandra/cassandra-monitoring/cas-read-and-cas-write/)
- [ Apache Cassandra Add-Ons+ ](#section-cassandra-add-ons)
    - [ Apache Spark Add-On for Apache Cassandra ](#section-cassandra-add-ons-apache-spark)
        - [ Getting Started with the Apache Spark Add-On for Apache Cassandra ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/getting-started-with-instaclustr-spark-cassandra/)
        - [ Getting started with Spark Jobserver and Instaclustr ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/getting-started-with-spark-jobserver-and-instaclustr/)
        - [ Connecting to Spark via JDBC/ODBC Thrift Server ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/connecting-spark-via-jdbc-odbc-thrift-server/)
        - [ Instaclustr Spark with SSL configured Apache Cassandra Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/instaclustr-spark-with-ssl-configured-cassandra-cluster/)
        - [ Apache Spark Streaming, Apache Kafka and Apache Cassandra Tutorial ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/spark-streaming-kafka-and-cassandra-tutorial/)
        - [ Spark MLlib Linear Regression Example ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/spark-mllib-linear-regression-example/)
        - [ Enable Logging for Completed Applications ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/enable-logging-completed-applications/)
        - [ Useful Apache Spark References ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/apache-spark/useful-apache-spark-references/)
    - [ Apache Lucene ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/lucene/)
    - [ Continuous Backup ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/continuous-backup/)
    - [ Private Network Cluster ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/private-network-cluster/)
    - [ Apache Cassandra PCI ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/pci/)
    - [ Creating a Cassandra Cluster with Debezium Connector ](https://instaclustr.husldigital.com/support/documentation/cassandra-add-ons/creating-a-cassandra-cluster-with-debezium-connector/)
- [ Apache Kafka+ ](#section-kafka)
    - [ Useful Concepts ](#section-kafka-useful-concepts)
        - [ Apache Kafka Client ⇄ Broker Encryption &amp; Mutual Authentication (mTLS) ](https://instaclustr.husldigital.com/support/documentation/kafka/useful-concepts/mtls/)
        - [ Apache Kafka Client Telemetry ](https://instaclustr.husldigital.com/support/documentation/kafka/useful-concepts/apache-kafka-client-telemetry/)
        - [ Apache Kafka KRaft ](https://instaclustr.husldigital.com/support/documentation/kafka/useful-concepts/apache-kafka-kraft-useful-information/)
        - [ Apache Kafka Tiered Storage ](https://instaclustr.husldigital.com/support/documentation/kafka/useful-concepts/kafka-tiered-storage/)
        - [ Partition Reassignment ](https://instaclustr.husldigital.com/support/documentation/kafka/useful-concepts/partition-reassignment/)
        - [ Zookeeper to KRaft Migration Process ](https://instaclustr.husldigital.com/support/documentation/kafka/useful-concepts/zookeeper-to-kraft-migration-process/)
    - [ Getting Started with Apache Kafka ](#section-kafka-getting-started-with-kafka)
        - [ Creating an Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/creating-a-kafka-cluster/)
        - [ Creating an Apache Kafka® Cluster With Client ⇄ Broker Encryption &amp; Mutual Authentication (mTLS) Enabled ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/connecting-to-a-kafka-mtls-cluster/)
        - [ Creating a PCI Compliant Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/creating-a-pci-compliant-cluster/)
        - [ Creating a PrivateLink Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/creating-a-privatelink-kafka-cluster/)
        - [ Creating a Private Service Connect Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/creating-a-private-service-connect-apache-kafka-cluster/)
        - [ Creating an Apache Kafka Cluster in a Custom VPC ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/custom-vpc/)
        - [ Creating an Apache Kafka cluster with dedicated KRaft Controller nodes ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/creating-an-apache-kafka-cluster-with-dedicated-kraft-controller-nodes/)
        - [ Creating a Apache Kafka cluster with dedicated Zookeeper nodes ](https://instaclustr.husldigital.com/support/documentation/kafka/getting-started-with-kafka/creating-a-kafka-cluster-with-dedicated-zookeeper-nodes/)
    - [ Using Apache Kafka ](#section-kafka-using-kafka)
        - [ Configuring the Keystore to Use Client ⇄ Broker Encryption &amp; Mutual Authentication (mTLS) For Apache Kafka Client ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/configure-keystore-to-use-mtls-authentication-with-clients/)
        - [ Converting Keystore (JKS) to PEM file ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/converting-jks-to-pem-file/)
        - [ Managing Certificates on a Client ⇄ Broker Encryption &amp; Mutual Authentication (mTLS) Enabled Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/managing-certificates-with-mtls/)
        - [ Using Apache Kafka Share Groups / Queues ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/using-apache-kafka-share-groups-queues/)
        - [ Using Kafka Client Telemetry ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/using-kafka-client-telemetry/)
        - [ Connect to an Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/connect-to-a-kafka-cluster/)
        - [ Connect to a Private Service Connect Apache Kafka cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/connecting-to-a-private-service-connect-apache-kafka-cluster/)
        - [ Connect to a PrivateLink Apache Kafka Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/connect-to-a-privatelink-kafka-cluster/)
        - [ Connect to a PrivateLink Apache Kafka cluster with AWS CloudFormation ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/connect-to-a-privatelink-kafka-cluster-with-aws-cloudformation/)
        - [ Managing Principal ARNs of an Apache Kafka Cluster with AWS PrivateLink ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/managing-principal-arns-of-a-privatelink-kafka-cluster/)
        - [ Use Apache Kafka with the Command Line ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/use-kafka-with-the-command-line/)
        - [ Use Apache Kafka with Java ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/use-kafka-with-java/)
        - [ Use Apache Kafka with Python ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/use-kafka-with-python/)
        - [ Use Apache Kafka with Ruby ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/use-kafka-with-ruby/)
        - [ Use Apache Kafka with C# ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/use-kafka-with-c-sharp/)
        - [ Working with Apache Kafka Streams API ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/working-with-kafka-streams-api/)
        - [ Connect to Apache Kafka and Kafka Connect Using VPC Peering (AWS) ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/connect-to-kafka-cluster-vpc-peering-aws/)
        - [ Using Certificates with Apache Kafka Clients ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/how-to-use-certificates-with-kafka-clients/)
        - [ Managing Apache Kafka Topics ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/topic-management/)
        - [ Managing Apache Kafka Users ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/kafka-user-management-2/)
        - [ Managing Apache Kafka ACLs ](https://instaclustr.husldigital.com/support/documentation/kafka/using-kafka/kafka-acl-management/)
    - [ Apache Kafka Cluster Operations ](#section-kafka-kafka-cluster-operations)
        - [ Scaling your cluster horizontally ](https://instaclustr.husldigital.com/support/documentation/kafka/kafka-cluster-operations/scaling-your-cluster-horizontally/)
        - [ Scaling your cluster vertically ](https://instaclustr.husldigital.com/support/documentation/kafka/kafka-cluster-operations/scaling-your-cluster-vertically/)
        - [ Setting up Mirror Maker ](https://instaclustr.husldigital.com/support/documentation/kafka/kafka-cluster-operations/setting-up-mirror-maker/)
        - [ Modifiable Broker Settings ](https://instaclustr.husldigital.com/support/documentation/kafka/kafka-cluster-operations/modifiable-broker-settings/)
        - [ Cluster Config Backup ](https://instaclustr.husldigital.com/support/documentation/kafka/kafka-cluster-operations/cluster-config-backup/)
    - [ Apache Kafka Monitoring Metrics Documentation ](#section-kafka-monitoring-information)
        - [ Accessing Monitoring Information ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/accessing-monitoring-information/)
        - [ Apache Kafka Schema Registry Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/kafka-schema-registry-metrics/)
        - [ Consumer Group Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/kafka-consumer-group/)
        - [ Consumer Group States ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/consumer-group-states/)
        - [ Broker Topic Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/broker-topic-metrics/)
        - [ Leader Election Rate and Time Ms ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/leader-election-rate-time-ms/)
        - [ Message Conversions ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/message-conversions/)
        - [ Network and Request Handler Capacity ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/network-and-request-handler-capacity/)
        - [ Fetcher Lag Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/fetcher-lag-metrics/)
        - [ Partition Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/partition-metrics/)
        - [ Fetcher Manager Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/fetcher-manager-metrics/)
        - [ Per-Topic Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/per-topic-metrics/)
        - [ Replicas ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/replicas/)
        - [ Request Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/request-metrics/)
        - [ Synthetic Transactions | Kafka Documentation ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/synthetic-transactions/)
        - [ Disk Usage | Kafka Documentation ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/disk-usage/)
        - [ Delayed Operations ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/delayed-operations/)
        - [ Garbage Collection ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/garbage-collection/)
        - [ Network | Apache Kafka Documentation ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/network/)
        - [ Memory | Kafka Documentation ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/memory/)
        - [ CPU Usage | Kafka Documentation ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/cpu-usage/)
        - [ Additional CPU - Kafka ](https://instaclustr.husldigital.com/support/documentation/kafka/monitoring-information/additional-cpu/)
- [ Apache Kafka Add-Ons+ ](#section-kafka-add-ons)
    - [ Apache Kafka REST Proxy ](https://instaclustr.husldigital.com/support/documentation/kafka-add-ons/kafka-rest-proxy/)
    - [ Using the Apache Kafka Schema Registry ](https://instaclustr.husldigital.com/support/documentation/kafka-add-ons/using-the-kafka-schema-registry/)
    - [ Enabling PCI ](https://instaclustr.husldigital.com/support/documentation/kafka-add-ons/pci/)
    - [ Using the Karapace Schema Registry ](https://instaclustr.husldigital.com/support/documentation/kafka-add-ons/using-the-karapace-schema-registry/)
    - [ Using the Karapace REST Proxy ](https://instaclustr.husldigital.com/support/documentation/kafka-add-ons/using-the-karapace-rest-proxy/)
    - [ Using Kafka Tiered Storage ](https://instaclustr.husldigital.com/support/documentation/kafka-add-ons/using-kafka-tiered-storage/)
- [ Apache Kafka Connect+ ](#section-kafka-connect)
    - [ Getting Started With Apache Kafka Connect ](#section-kafka-connect-getting-started-with-kafka-connect)
        - [ Creating an Apache Kafka Connect Cluster ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/getting-started-with-kafka-connect/creating-a-kafka-connect-cluster/)
        - [ Custom Kafka Connect Connectors ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/getting-started-with-kafka-connect/custom-kafka-connect-connectors/)
        - [ Use IAM roles and policies to provide the Kafka Connect cluster with access to AWS S3 bucket ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/getting-started-with-kafka-connect/use-iam-roles-and-policies-to-provide-the-kafka-connect-cluster-with-access-to-aws-s3-bucket/)
        - [ Using non-Instaclustr Kafka Clusters ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/getting-started-with-kafka-connect/using-non-instaclustr-kafka-clusters/)
    - [ Using Apache Kafka Connect ](#section-kafka-connect-using-kafka-connect)
        - [ Interacting with Apache Kafka Connect ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/interacting-with-kafka-connect/)
        - [ Connect to Instaclustr Managed Clusters ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/connect-kafka-connect-to-other-clusters/)
        - [ Updating custom connectors ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/updating-custom-connectors/)
        - [ Starting a connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/starting-a-connector/)
        - [ Troubleshooting your Kafka connectors ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/troubleshooting-your-kafka-connectors/)
        - [ Tutorial: Using Kafka with Amazon S3 ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/store-kafka-data-amazon-s3/)
        - [ Tutorial: Using Kafka with MQTT ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/using-kafka-mqtt/)
    - [ Bundled Connectors ](#section-kafka-connect-bundled-kafka-connect-plugins)
        - [ Apache Cassandra Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/cassandra-connector/)
        - [ AWS S3 Source and Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/instaclustr-aws-s3-kafka-connect-plugins/)
        - [ ClickHouse Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/clickhouse-kafka-connect-sink/)
        - [ Elasticsearch Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/elasticsearch-connector/)
        - [ JDBC Source and Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/jdbc-source-and-sink-connectors-for-apache-kafka/)
        - [ OpenSearch Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/opensearch-sink-connector/)
        - [ SLA Sink Connector ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/instaclustr-kafka-connect-sla-sink-plugin/)
    - [ Kafka Mirroring with Kafka Connect ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/kafka-mirroring-with-kafka-connect/)
    - [ Kafka Connect Monitoring Metrics Documentation ](#section-kafka-connect-monitoring-information)
        - [ Worker Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/monitoring-information/worker-metrics/)
        - [ Worker Rebalance Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/monitoring-information/worker-rebalance-metrics/)
        - [ Availability Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/monitoring-information/availability-metrics/)
        - [ Source Connector Metrics ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/monitoring-information/source-connector-metrics/)
- [ OpenSearch+ ](#section-opensearch)
    - [ Getting started with OpenSearch ](#section-opensearch-getting-started-with-opensearch)
        - [ Creating a PCI Compliant OpenSearch Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-a-pci-compliant-opensearch-cluster/)
        - [ Creating an OpenSearch Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-an-opensearch-cluster/)
        - [ Creating an OpenSearch Cluster using Terraform ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-an-opensearch-cluster-using-terraform/)
        - [ Creating an OpenSearch Cluster with Cross-cluster Replication ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-an-opensearch-cluster-with-cross-cluster-replication/)
        - [ Creating an OpenSearch Cluster with Dedicated Cluster Manager ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-an-opensearch-cluster-with-dedicated-cluster-manager/)
        - [ Creating an OpenSearch Cluster with Dedicated Ingest Nodes ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-an-opensearch-cluster-with-dedicated-ingest-nodes/)
        - [ Creating an OpenSearch Cluster with OpenSearch Dashboards ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-an-opensearch-cluster-with-opensearch-dashboards/)
        - [ Creating a PrivateLink OpenSearch Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/getting-started-with-opensearch/creating-a-privatelink-opensearch-cluster/)
    - [ Using OpenSearch ](#section-opensearch-using-opensearch)
        - [ Connect to an OpenSearch Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-to-an-opensearch-cluster/)
        - [ Security Access Control ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/security-access-control/)
        - [ Connect to OpenSearch Using cURL ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-to-opensearch-using-curl/)
        - [ Connect to OpenSearch with Java ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-to-opensearch-with-java/)
        - [ Connect to OpenSearch with Python ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-to-opensearch-with-python/)
        - [ Connect to OpenSearch with C# ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-to-opensearch-with-c-sharp/)
        - [ Connect to a PrivateLink OpenSearch Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-to-a-privatelink-opensearch-cluster/)
        - [ Use VPC Peering (AWS) to Connect to OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/use-vpc-peering-aws-to-connect-to-opensearch/)
        - [ Connect Logstash to OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/connect-logstash-to-opensearch/)
        - [ How to perform a snapshot migration from Amazon OpenSearch Service ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch/aws-opensearch-service-snapshot-migration-guide/)
    - [ Using OpenSearch Dashboards ](#section-opensearch-using-opensearch-dashboards)
        - [ Configuring OpenSearch Dashboards ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-dashboards/configuring-opensearch-dashboards/)
        - [ Connect to OpenSearch Dashboards ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-dashboards/connect-to-opensearch-dashboards/)
        - [ Connect an OpenID Connect (OIDC) Provider - OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-dashboards/connect-an-openid-connect-oidc-provider/)
    - [ Using OpenSearch Plugins ](#section-opensearch-using-opensearch-plugins)
        - [ List of Available OpenSearch Plugins ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/list-of-available-opensearch-plugins/)
        - [ AI Search Plugin ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/ai-search-plugin/)
        - [ k-NN Plugin ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/knn-plugin/)
        - [ Alerting and Notifications Plugins ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/alerting-and-notifications-plugins/)
        - [ Anomaly Detection Plugin ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/anomaly-detection-plugin/)
        - [ Asynchronous Search Plugin ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/asynchronous-search/)
        - [ SQL Plugin ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/sql/)
        - [ Observability Plugin ](https://instaclustr.husldigital.com/support/documentation/opensearch/using-opensearch-plugins/observability-plugin/)
    - [ OpenSearch Cluster Operations ](#section-opensearch-opensearch-cluster-operations)
        - [ Expanding Your Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-cluster-operations/expanding-your-cluster/)
        - [ OpenSearch Cluster Indices Backup ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-cluster-operations/cluster-indices-backup/)
        - [ Cluster Indices Restore - OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-cluster-operations/cluster-indices-restore/)
        - [ In-place Resizing for OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-cluster-operations/in-place-resizing-for-opensearch/)
        - [ Managing Principal ARNs of a PrivateLink OpenSearch Cluster ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-cluster-operations/managing-principal-arns-of-a-privatelink-opensearch-cluster/)
    - [ OpenSearch Monitoring Metrics Documentation ](#section-opensearch-opensearch-monitoring-metrics-documentation)
        - [ Accessing OpenSearch Monitoring Tools ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/accessing-opensearch-monitoring-tools/)
        - [ OpenSearch Document ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/document/)
        - [ Index ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/index/)
        - [ Query ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/query/)
        - [ OpenSearch JVM ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/jvm/)
        - [ Monitoring CPU Usage OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/monitoring-cpu-usage/)
        - [ OS Load - OpenSearch ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/os-load/)
        - [ OpenSearch Disk Usage ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/opensearch-disk-usage/)
        - [ OpenSearch Network ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/opensearch-network/)
        - [ OpenSearch Memory ](https://instaclustr.husldigital.com/support/documentation/opensearch/opensearch-monitoring-metrics-documentation/opensearch-memory/)
- [ OpenSearch Add-Ons+ ](#section-opensearch-add-ons)
    - [ OpenSearch Searchable Snapshots ](https://instaclustr.husldigital.com/support/documentation/opensearch-add-ons/opensearch-searchable-snapshots/)
    - [ OpenSearch Load Balancer ](https://instaclustr.husldigital.com/support/documentation/opensearch-add-ons/opensearch-load-balancer/)
- [ PostgreSQL+ ](#section-postgresql)
    - [ Getting Started with PostgreSQL ](#section-postgresql-getting-started-with-postgresql)
        - [ Creating a PostgreSQL Cluster ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/getting-started-with-postgres-creating-a-postgres-cluster/)
        - [ Creating a PostgreSQL Cluster with AWS PrivateLink ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/creating-a-postgresql-cluster-with-aws-privatelink/)
        - [ Creating a PostgreSQL Cluster with Azure Private Link ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/creating-a-postgresql-cluster-with-azure-private-link/)
        - [ Creating a PostgreSQL Cluster in a Custom VPC/VNet ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/creating-a-postgresql-cluster-in-a-custom-vpc-vnet/)
        - [ Creating a PostgreSQL Cluster with Azure NetApp Files ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/creating-a-postgresql-cluster-with-azure-netapp-files/)
        - [ Creating a PostgreSQL Multi-Region Replication (MRR) Cluster with Instaclustr ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/creating-a-postgresql-multi-region-replication-mrr-cluster-with-instaclustr/)
        - [ Creating a PCI Compliant PostgreSQL Cluster ](https://instaclustr.husldigital.com/support/documentation/postgresql/getting-started-with-postgresql/creating-a-pci-compliant-postgresql-cluster/)
    - [ Using PostgreSQL ](#section-postgresql-using-postgresql)
        - [ Available Extensions ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/available-extensions/)
        - [ Change PostgreSQL Default User Password ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/change-postgresql-default-user-password/)
        - [ Connect to a PostgreSQL Cluster ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/connect-to-a-postgresql-cluster/)
        - [ Connect to an AWS PrivateLink enabled PostgreSQL Cluster ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/connect-to-an-aws-privatelink-enabled-postgresql-cluster/)
        - [ Connect to an Azure Private Link enabled PostgreSQL Cluster ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/connect-to-an-azure-private-link-enabled-postgresql-cluster/)
        - [ Connect to PostgreSQL with C++ ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/connect-to-postgresql-with-c-plus-plus/)
        - [ Connect to PostgreSQL with Java ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/connect-to-postgresql-with-java/)
        - [ Connect to PostgreSQL with Python ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/connect-to-postgresql-with-python/)
        - [ Customer Administration Role ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/customer-administration-role/)
        - [ Enable or disable a PostgreSQL extension ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/enable-or-disable-a-postgresql-extension/)
        - [ Extensions that require additional Instantiation steps ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/extensions-that-require-additional-instantiation-steps/)
        - [ How Clients Connect to a PostgreSQL Cluster Using Azure Private Link connection ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/how-clients-connect-to-a-postgresql-cluster-using-azure-private-link-connection/)
        - [ Managing Principal ARNs of a PostgreSQL Cluster with AWS PrivateLink ](https://instaclustr.husldigital.com/support/documentation/postgresql/using-postgresql/managing-principal-arns-of-a-postgresql-cluster-with-aws-privatelink/)
    - [ PostgreSQL Cluster Operations ](#section-postgresql-postgresql-cluster-operations)
        - [ Backup ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/backup/)
        - [ Restore ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/restore/)
        - [ Reloading a Node ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/reloading-a-node/)
        - [ Modifying Configuration ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/modifying-configuration/)
        - [ Replication and High Availability ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/replication-and-high-availability/)
        - [ In-place Resizing for PostgreSQL ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/in-place-resizing-for-postgresql/)
        - [ Azure NetApp Files Fast Forking ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-cluster-operations/azure-netapp-files-fast-forking/)
    - [ PostgreSQL Monitoring Documentation ](#section-postgresql-postgresql-monitoring-documentation)
        - [ Miscellaneous Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/misc-metrics/)
        - [ Transaction Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/transaction-metrics/)
        - [ Replication and Replication Slot Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/replication-and-replication-slot-metrics/)
        - [ Table Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/table-metrics/)
        - [ Database Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/database-metrics/)
        - [ Synthetic Transaction Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/synthetic-transactions/)
        - [ CPU Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/cpu-metrics/)
        - [ CPU Detailed Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/cpu-detailed-metrics/)
        - [ Disk Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/disk-metrics/)
        - [ Memory Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/memory-metrics/)
        - [ Network Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-monitoring-documentation/network-metrics/)
    - [ Cluster Creation Options ](#section-postgresql-options)
        - [ Replication Mode ](https://instaclustr.husldigital.com/support/documentation/postgresql/options/replication-mode/)
        - [ Synchronous Mode Strict ](https://instaclustr.husldigital.com/support/documentation/postgresql/options/synchronous-mode-strict/)
    - [ PostgreSQL with AWS FSx for NetApp ONTAP ](#section-postgresql-postgresql-with-aws-fsx-for-netapp-ontap)
        - [ Creating a PostgreSQL Cluster with AWS FSx for NetApp ONTAP ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-with-aws-fsx-for-netapp-ontap/creating-a-postgresql-cluster-with-aws-fsx-for-netapp-ontap/)
        - [ AWS FSx for NetApp ONTAP Snapshotting ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-with-aws-fsx-for-netapp-ontap/aws-fsx-for-netapp-ontap-snapshotting/)
        - [ AWS FSx for NetApp ONTAP Fast Forking ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-with-aws-fsx-for-netapp-ontap/aws-fsx-for-netapp-ontap-fast-forking/)
        - [ Creating a PostgreSQL Cluster in the Same VPC as an Existing FSx for NetApp ONTAP ](https://instaclustr.husldigital.com/support/documentation/postgresql/postgresql-with-aws-fsx-for-netapp-ontap/creating-a-postgresql-cluster-in-the-same-vpc-as-an-existing-fsx-for-netapp-ontap/)
- [ PostgreSQL Add-Ons+ ](#section-postgresql-add-ons)
    - [ Getting Started with PgBouncer ](https://instaclustr.husldigital.com/support/documentation/postgresql-add-ons/getting-started-with-pgbouncer/)
    - [ Using AWS Load Balancer ](https://instaclustr.husldigital.com/support/documentation/postgresql-add-ons/using-aws-load-balancer/)
    - [ Using PgBouncer ](https://instaclustr.husldigital.com/support/documentation/postgresql-add-ons/using-pgbouncer/)
    - [ PgBouncer Monitoring Metrics ](https://instaclustr.husldigital.com/support/documentation/postgresql-add-ons/pgbouncer-monitoring-metrics/)
- [ Cadence+ ](#section-cadence)
    - [ Getting Started with Cadence ](#section-cadence-getting-started-with-cadence)
        - [ Creating a Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/creating-a-cadence-cluster/)
        - [ Creating an Advanced Visibility Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/creating-an-advanced-visibility-cadence-cluster/)
        - [ Load Balancer Support ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/load-balancer-support/)
        - [ Create a Multi-Region Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/create-a-multi-region-cadence-cluster/)
        - [ Creating a PCI Compliant Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/creating-a-pci-compliant-cadence-cluster/)
        - [ Configuring the Cadence VPC ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/configuring-the-cadence-vpc/)
        - [ Cadence Advanced Visibility ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/cadence-advanced-visibility/)
        - [ Configuring your Cluster to Use Cadence Archival ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/configuring-your-cluster-to-use-cadence-archival/)
        - [ Cadence HTTP API ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/cadence-http-api/)
        - [ Creating a Cadence Cluster with HTTP API ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/creating-a-cadence-cluster-with-http-api/)
        - [ Creating a PrivateLink Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/getting-started-with-cadence/creating-a-privatelink-cadence-cluster/)
    - [ Using Cadence ](#section-cadence-using-cadence)
        - [ Securing Cadence Web Using NGINX ](https://instaclustr.husldigital.com/support/documentation/cadence/using-cadence/securing-cadence-web-using-nginx/)
        - [ Connect to a PrivateLink Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/using-cadence/connect-to-a-privatelink-cadence-cluster/)
        - [ Managing Principal ARNs of a PrivateLink Cadence Cluster ](https://instaclustr.husldigital.com/support/documentation/cadence/using-cadence/managing-principal-arns-of-a-privatelink-cadence-cluster/)
    - [ Cadence Cluster Operations ](#section-cadence-cadence-cluster-operations)
        - [ In-place Scaling for Cadence ](https://instaclustr.husldigital.com/support/documentation/cadence/cadence-cluster-operations/cadence-scaling/)
    - [ Cadence Monitoring Metrics Documentation ](#section-cadence-monitoring-information)
        - [ Accessing Monitoring Information ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/accessing-monitoring-information/)
        - [ Cadence Node CPU Usage ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/node-cpu-usage/)
        - [ Node Disk Usage ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/node-disk-usage/)
        - [ Node Memory Usage ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/node-memory/)
        - [ Node Network Usage ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/node-network-usage/)
        - [ Cadence Synthetic Workflows ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-synthetic-workflows/)
        - [ Cadence Global Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-frontend-metrics/)
        - [ Cadence Persistence Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-persistence-metrics/)
        - [ Cadence General Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-metrics/)
        - [ Cadence Matching Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-matching-metrics/)
        - [ Cadence History Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-history-metrics-2/)
        - [ Cadence Workflow (tag-level) Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/cadence-workflow-tag-level-metrics/)
        - [ Multi-Region Cadence Replication Metrics ](https://instaclustr.husldigital.com/support/documentation/cadence/monitoring-information/multi-region-cadence-replication-metrics/)
- [ ClickHouse+ ](#section-clickhouse)
    - [ Getting Started with ClickHouse ](#section-clickhouse-getting-started-with-clickhouse)
        - [ Creating a ClickHouse Cluster ](https://instaclustr.husldigital.com/support/documentation/clickhouse/getting-started-with-clickhouse/creating-a-clickhouse-cluster/)
        - [ Creating a ClickHouse Cluster in the Same VPC as an Existing FSx ONTAP ](https://instaclustr.husldigital.com/support/documentation/clickhouse/getting-started-with-clickhouse/creating-a-clickhouse-cluster-in-the-same-vpc-as-an-existing-fsx-ontap/)
        - [ Configure a ClickHouse Cluster for Tiered Storage ](https://instaclustr.husldigital.com/support/documentation/clickhouse/getting-started-with-clickhouse/configure-a-clickhouse-cluster-for-tiered-storage/)
        - [ Creating an AWS PrivateLink ClickHouse Cluster ](https://instaclustr.husldigital.com/support/documentation/clickhouse/getting-started-with-clickhouse/creating-an-aws-privatelink-clickhouse-cluster/)
    - [ Using a ClickHouse Cluster ](#section-clickhouse-using-a-clickhouse-cluster)
        - [ ClickHouse Cluster Macros ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/documentation-clickhouse-using-a-clickhouse-cluster-clickhouse-cluster-macros/)
        - [ Cluster Managing Principal ARNs of a PrivateLink ClickHouse Cluster ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/cluster-managing-principal-arns-of-a-privatelink-clickhouse-cluster/)
        - [ Connecting to a ClickHouse Cluster ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-a-clickhouse-cluster/)
        - [ Connecting to an AWS PrivateLink ClickHouse Cluster ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-an-aws-privatelink-clickhouse-cluster/)
        - [ Use VPC Peering (AWS) to Connect to NetApp Instaclustr-Managed ClickHouse ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/use-aws-vpc-peering-to-connect-to-clickhouse/)
        - [ Connecting to ClickHouse with ClickHouse Client ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-clickhouse-with-clickhouse-client/)
        - [ Connecting to ClickHouse with Java ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-clickhouse-with-java/)
        - [ Connecting to ClickHouse with Go ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-clickhouse-with-go/)
        - [ Connecting to ClickHouse with Python ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-clickhouse-with-python/)
        - [ Connecting to ClickHouse from Apache Superset™ ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/connecting-to-clickhouse-from-apache-superset/)
        - [ ClickHouse Cluster Backup and Restore ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/clickhouse-cluster-backup-and-restore/)
        - [ ClickHouse Cluster Resizing ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/documentation-clickhouse-using-a-clickhouse-cluster-scaling-a-clickhouse-cluster/)
        - [ Configuring ClickHouse Parameters ](https://instaclustr.husldigital.com/support/documentation/clickhouse/using-a-clickhouse-cluster/configuration/)
    - [ ClickHouse Integrations ](#section-clickhouse-integrations)
        - [ AWS S3 Region Integration ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/aws-s3-integration/)
        - [ AWS Private S3 Bucket Integration ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/private-s3/)
        - [ AWS FSx for NetApp ONTAP Integration ](#section-clickhouse-integrations-s3-fsx-for-ontap)
            - [ AWS FSx for NetApp ONTAP Integration: Instaclustr-Managed FSx ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/s3-fsx-for-ontap/instaclustr-managed-fsx/)
            - [ AWS FSx for NetApp ONTAP Integration: Self-Managed FSx ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/s3-fsx-for-ontap/self-managed-fsx/)
        - [ Domain Integration ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/domain-integration/)
        - [ Kafka Integration ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/kafka/)
        - [ Open Table Format Integration ](https://instaclustr.husldigital.com/support/documentation/clickhouse/integrations/open-table-format/)
    - [ Useful Concepts ](#section-clickhouse-useful-concepts)
        - [ Dedicated ClickHouse Keeper for ClickHouse Clusters ](https://instaclustr.husldigital.com/support/documentation/clickhouse/useful-concepts/dedicated-clickhouse-keeper/)
        - [ Load Balancer for ClickHouse Clusters ](https://instaclustr.husldigital.com/support/documentation/clickhouse/useful-concepts/clickhouse-load-balancer/)
        - [ Tiered Storage for ClickHouse Clusters ](https://instaclustr.husldigital.com/support/documentation/clickhouse/useful-concepts/creating-a-clickhouse-cluster-with-tiered-storage/)
    - [ Visualising ClickHouse Data ](#section-clickhouse-visualising-clickhouse-data)
        - [ Connecting to ClickHouse from Grafana ](https://instaclustr.husldigital.com/support/documentation/clickhouse/visualising-clickhouse-data/connecting-to-clickhouse-from-grafana/)
    - [ ClickHouse Monitoring Metrics Documentation ](#section-clickhouse-monitoring-information)
        - [ Accessing Monitoring Information ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/accessing-monitoring-information/)
        - [ CPU Usage ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/cpu-usage/)
        - [ Disk Usage ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/disk-usage/)
        - [ Memory Usage ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/memory-usage/)
        - [ Network Usage ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/network-usage/)
        - [ Availability Metrics ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/availability-metrics/)
        - [ Active Queries ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/active-queries/)
        - [ Internal Replication Tasks ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/internal-replication-tasks/)
        - [ Read and Write ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/read-and-write/)
        - [ Mark Cache ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/mark-cache/)
        - [ Query Cache ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/query-cache/)
        - [ Uncompressed Cache ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/uncompressed-cache/)
        - [ Remote Storage ](https://instaclustr.husldigital.com/support/documentation/clickhouse/monitoring-information/remote-storage/)
- [ MCP Gateway+ ](#section-mcp-gateway)
    - [ Getting Started with MCP Gateway ](#section-mcp-gateway-getting-started-with-mcp-gateway)
        - [ Creating an MCP Gateway Cluster ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/getting-started-with-mcp-gateway/creating-an-mcp-gateway-cluster/)
    - [ Using MCP Gateway ](#section-mcp-gateway-using-mcp-gateway)
        - [ MCP Gateway Concepts ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/mcp-gateway-concepts/)
        - [ Configure MCP Virtual Server ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-mcp-virtual-server/)
        - [ Connecting to an MCP Gateway Virtual Server ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/connecting-to-an-mcp-gateway-virtual-server/)
        - [ Configure Cassandra MCP Backend and Tools ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-cassandra-mcp-backend-and-tools/)
        - [ Configure Kafka MCP Backend and Tools ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-kafka-mcp-backend-and-tools/)
        - [ Configure OpenSearch MCP Backend and Tools ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-opensearch-mcp-backend-and-tools-duplicate/)
        - [ Configure HTTP Server MCP Backend and Tools ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-http-server-mcp-backend-and-tools/)
        - [ Configure Instaclustr API Server MCP Backend and Tools ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-instaclustr-api-server-mcp-backend-and-tools/)
        - [ Configure MCP Tool Access ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/using-mcp-gateway/configure-mcp-tool-access/)
    - [ MCP Gateway Cluster Operations ](#section-mcp-gateway-mcp-gateway-cluster-operations)
        - [ Scale Your Cluster ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/mcp-gateway-cluster-operations/expanding-your-cluster/)
        - [ Backup and Restore Your Cluster ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/mcp-gateway-cluster-operations/backup-and-restore-your-mcp-gateway-cluster/)
    - [ Identity Provider example configurations ](#section-mcp-gateway-mcp-gateway-identity-providers)
        - [ Auth0 example configuration ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/mcp-gateway-identity-providers/mcp-gateway-auth0-example-configuration/)
        - [ Okta example configuration ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/mcp-gateway-identity-providers/mcp-gateway-okta-example-configuration/)
        - [ Entra ID example configuration ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/mcp-gateway-identity-providers/entra-id-example-configuration/)
        - [ Keycloak example configuration ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway/mcp-gateway-identity-providers/mcp-gateway-keycloak-example-configuration/)
- [ MCP Gateway Add-Ons+ ](#section-mcp-gateway-add-ons)
    - [ MCP Gateway Load Balancer ](https://instaclustr.husldigital.com/support/documentation/mcp-gateway-add-ons/mcp-gateway-load-balancer/)
 
  

 ###### [API &amp; Integrations](https://instaclustr.husldigital.com/support/api-integrations/)

###### [API &amp; Integrations](https://instaclustr.husldigital.com/support/api-integrations/)

- [ API Reference+ ](#section-api-reference)
    - [ Cluster Management API ](https://instaclustr.husldigital.com/support/api-integrations/api-reference/cluster-management-api/)
    - [ Monitoring API ](https://instaclustr.husldigital.com/support/api-integrations/api-reference/monitoring-api/)
    - [ Rate Limits ](#section-api-reference-rate-limits)
        - [ Instaclustr API Rate Limits ](https://instaclustr.husldigital.com/support/api-integrations/api-reference/rate-limits/instaclustr-api-rate-limits/)
    - [ Set Up a BYOC Provider Account Using the API ](https://instaclustr.husldigital.com/support/api-integrations/api-reference/set-up-a-byoc-provider-account-using-the-api/)
- [ Integrations+ ](#section-integrations)
    - [ Instaclustr Monitoring with Prometheus ](https://instaclustr.husldigital.com/support/api-integrations/integrations/instaclustr-monitoring-with-prometheus/)
    - [ Terraform Code Generation ](https://instaclustr.husldigital.com/support/api-integrations/integrations/terraform-code-generation/)
    - [ Using the Instaclustr Monitoring API with Datadog ](https://instaclustr.husldigital.com/support/api-integrations/integrations/using-the-instaclustr-monitoring-api-with-datadog/)
    - [ Using the Instaclustr Terraform Provider v2 ](https://instaclustr.husldigital.com/support/api-integrations/integrations/using-the-instaclustr-terraform-provider/)
    - [ Using Instaclustr with Kong ](https://instaclustr.husldigital.com/support/api-integrations/integrations/using-instaclustr-with-kong/)
    - [ Sending Instaclustr Metrics to New Relic via Prometheus ](https://instaclustr.husldigital.com/support/api-integrations/integrations/sending-instaclustr-metrics-to-new-relic-via-prometheus/)
    - [ Using Instaclustr from Heroku ](https://instaclustr.husldigital.com/support/api-integrations/integrations/using-instaclustr-from-heroku/)
 
  

 

Back to full documentation



 

 

 

 

 

Tutorial: Using Kafka with Amazon S3
====================================

In this tutorial, we will learn how to log Kafka data in an AWS S3 bucket by using Kafka Connect and the Bundled Instaclustr S3 connector.

You will need:

- An AWS Account
- An Instaclustr Account
 
Create S3 Bucket
----------------

We begin by creating the S3 bucket in AWS which we will use as the data sink for all of the data sent through a Kafka cluster.

Follow the steps in the AWS documentation to set up an empty S3 Bucket to use for this project:

(Note, although the documentation instructs you to create your Bucket in Oregon, we recommend creating it in whichever region you intend to spin up your Kafka and Kafka Connect Clusters)

<https://docs.aws.amazon.com/quickstarts/latest/s3backup/step-1-create-bucket.html>

We recommend creating an entirely new S3 bucket for this tutorial to make set-up and testing as simple as possible.

Kafka Connect Configuration
---------------------------

We now switch to the Instaclustr console which will allow us to provision the Kafka and Kafka Connect clusters which we will connect to our S3 bucket. By the time we are finished we will have the following configuration:

![S3 Configuration Diagram](https://instaclustr.husldigital.com/wp-content/uploads/2021/10/S3_Diagram-1024x299.png)

### Creating Kafka Cluster

Create a Kafka Cluster in using the Instaclustr console with the following properties (for values which haven’t been provided in the table, use the default values):

    Name: Kafka\_S3\_Test\_Cluster   Security: Add Local IP to cluster firewall allowed addresses   **WARNING: Ensure that you set the firewall rules of the Kafka cluster so your local machine has access. Later on in the process, we will need to use the CLI to create the test topic in our Kafka cluster and to do this we will need to have access to the cluster.**

### Creating Kafka Connect Cluster

Wait until the Kafka cluster has been created and all the nodes in the cluster are running before creating the Kafka Connect Cluster. The Kafka Connect Cluster is attached to the Kafka cluster we just provisioned and links to our S3 bucket via a custom connector.

Set the target cluster of the Kafka Connect Cluster to be the Kafka cluster which you provisioned in the previous step.

    Name: Kafka\_Connect\_S3\_Test\_Cluster   Kafka Cluster Name Kafka\_S3\_Test\_Cluster   VPC Configuration Kafka Cluster VPC   Security: Add Local IP to cluster firewall allowed addresses   This should produce a setup like the following in your Instaclustr console:

![](https://instaclustr.husldigital.com/wp-content/uploads/2021/10/Kafka_Connect_S3_Test_Cluster.png)

Ensure both of your clusters are successfully provisioned with a status of “Running” before continuing to the next steps.

### Create Kafka Topic

For Kafka Connect to work, sources and sinks must refer to specific Kafka Topics. Create a new Kafka Topic named “**S3TestTopic**”. For Kafka Connect to work, sources and sinks must refer to specific Kafka Topics. Create a new Kafka Topic named “S3TestTopic”. Instructions can be accessed by Navigating to the ‘Connection Info’ tab of your Kafka Cluster:

![](https://instaclustr.husldigital.com/wp-content/uploads/2018/07/Connection-info-2048x886.jpg)

And scrolling down to the ‘Topic Management’ tab of the ‘Examples’ section:

![](https://instaclustr.husldigital.com/wp-content/uploads/2018/07/Topic-Management-1-2048x823.png)

Note that the instructions are for creating a topic named “test”, this argument should be changed in the commands.

Follow the same steps to create a second topic named “**restored-S3TestTopic**”, this topic will be used for testing purposes when we try to read the contents of our S3 bucket back into Kafka.

Configure Instaclustr S3 Connector
----------------------------------

Now that we have a Kafka Cluster and a connected Kafka Connect cluster it is time to add a custom connector to allow us to export all messages sent along the **S3TestTopic** to our S3 bucket. To do this we use the Bundled Instaclustr S3 connector.

The configuration options for the Kafka Connect S3 Plug In are found here: <https://instaclustr.husldigital.com/support/documentation/kafka-connect/bundled-kafka-connect-plugins/instaclustr-aws-s3-kafka-connect-plugins/>

Run the curl command shown below to set up the custom connector to your S3 bucket. Note that in the example below the prefix is empty so all messages will be written to the root directory of the bucket.

    **&lt;ip-address-kafka-connect-node&gt;** This is the public ip address for any one of the nodes in the kafka connect cluster.   **&lt;s3-bucket-name&gt;** This refers to the name of the S3 bucket we created in the first step: provides a reference so the connector knows where to write to   **&lt;aws-access-key&gt;** The access key for an AWS account which has read and write access to the S3 bucket   **&lt;aws-secret-key&gt;** The secret key for an AWS account which has read and write access to the S3 bucket   **&lt;ic-kc-password&gt;** This is the password for the kafka connect cluster you provisioned in one of the previous steps. This value can be found by selecting your Kafka Connect cluster in the instaclustr console and navigating to the “Connection Info” tab. Importantly this value will be different to the password for your Kafka Cluster which you used in the previous step.    





























curl https://&lt;ip-address-kafka-connect-node&gt;:8083/connectors -X POST -H 'Content-Type: application/json' -d '{ "name":"sink", "config":{ "connector.class":"com.instaclustr.kafka.connect.s3.sink.AwsStorageSinkConnector", "tasks.max":"3", "topics":"S3TestTopic", "prefix":"", "aws.s3.bucket":"&lt;s3-bucket-name&gt;", "aws.accessKeyId":"&lt;aws-access-key&gt;", "aws.secretKey":"&lt;aws-secret-key&gt;", "value.converter":"org.apache.kafka.connect.converters.ByteArrayConverter", "key.converter":"org.apache.kafka.connect.converters.ByteArrayConverter" } }' -k -u ic\_kc\_user:&lt;ic-kc-password&gt;

   1

2

3

4

5

6

7

8

9

10

11

12

13

14



  curl https://&lt;ip-address-kafka-connect-node&gt;:8083/connectors -X POST -H 'Content-Type: application/json' -d '{

 "name":"sink",

 "config":{

 "connector.class":"com.instaclustr.kafka.connect.s3.sink.AwsStorageSinkConnector",

 "tasks.max":"3",

 "topics":"S3TestTopic",

 "prefix":"",

 "aws.s3.bucket":"&lt;s3-bucket-name&gt;",

 "aws.accessKeyId":"&lt;aws-access-key&gt;",

 "aws.secretKey":"&lt;aws-secret-key&gt;",

 "value.converter":"org.apache.kafka.connect.converters.ByteArrayConverter",

 "key.converter":"org.apache.kafka.connect.converters.ByteArrayConverter"

 }

}' -k -u ic\_kc\_user:&lt;ic-kc-password&gt;



   

 

 **WARNING: Ensure that you set the firewall rules of the kafka Connect cluster so your local machine has access. Otherwise, when you run this curl command on your machine it won’t be able to reach the Kafka connect Cluster.**

Start Test
----------

We have now set up our Kafka Connect and S3 configuration. It is now time to test our set up by configuring a console producer and sending some messages to our kafka cluster.

 





























./bin/kafka-console-producer.sh --broker-list &lt;broker1&gt;:9092,&lt;broker2&gt;:9092,&lt;broker3&gt;:9092 --producer.config &lt;path-to-kafka.properties&gt; --topic S3TestTopic

   1



  ./bin/kafka-console-producer.sh --broker-list &lt;broker1&gt;:9092,&lt;broker2&gt;:9092,&lt;broker3&gt;:9092 --producer.config &lt;path-to-kafka.properties&gt; --topic S3TestTopic



   

 

 This should open a command line prompt to enter messages. Start writing some messages to your producer, the contents of your messages are not important but we recommend you enter sequential values such as “message 1”, “message 2”, “message 3”, etc. as this will make the verification process easier.

 





























&gt; message 1 &gt; message 2 ... &gt;

   1

2

3

4



  &gt; message 1

&gt; message 2

...

&gt;



   

 

 After entering a series of messages it is time to check if what we have sent via our console producer has appeared in the S3 bucket. To do this we use the AWS CLI.

Run the following command to view the contents of the bucket:

 





























aws s3api list-objects --bucket "&lt;name-of-s3-bucket&gt;"

   1



  aws s3api list-objects --bucket "&lt;name-of-s3-bucket&gt;"



   

 

 It should show a log of the messages you have just added.

If you inspect one of the messages either through the AWS console or downloading it via the AWS CLI you will find it is in binary format.

Because the binary format is hard to read we instead have opted for using the source connector to restore the messages to Kafka and then reading them through the kafka console consumer.

### Configuring Bundled S3 Source Connector

This connector is used to read data back into the kafka topic which was written by the Bundled S3 Sink Connector.

To create this connector we use the following curl command:

 





























curl https://&lt;ip-address-kafka-connect-node&gt;:8083/connectors -X POST -H 'Content-Type: application/json' -d '{ "name":"source", "config":{ "connector.class":"com.instaclustr.kafka.connect.s3.source.AwsStorageSourceConnector", "tasks.max":"3", "kafka.topicPrefix":"restored", "s3.topics":"S3TestTopic", "aws.s3.bucket":"&lt;s3-bucket-name&gt;", "aws.accessKeyId":"&lt;aws-access-key&gt;", "aws.secretKey":"&lt;aws-secret-key&gt;", "value.converter":"org.apache.kafka.connect.converters.ByteArrayConverter", "key.converter":"org.apache.kafka.connect.converters.ByteArrayConverter", "prefix":"" } }' -k -u ic\_kc\_user:&lt;ic-kc-password&gt;

   1

2

3

4

5

6

7

8

9

10

11

12

13

14

15



  curl https://&lt;ip-address-kafka-connect-node&gt;:8083/connectors -X POST -H 'Content-Type: application/json' -d '{

 "name":"source",

 "config":{

 "connector.class":"com.instaclustr.kafka.connect.s3.source.AwsStorageSourceConnector",

 "tasks.max":"3",

 "kafka.topicPrefix":"restored",

 "s3.topics":"S3TestTopic",

 "aws.s3.bucket":"&lt;s3-bucket-name&gt;",

 "aws.accessKeyId":"&lt;aws-access-key&gt;",

 "aws.secretKey":"&lt;aws-secret-key&gt;",

 "value.converter":"org.apache.kafka.connect.converters.ByteArrayConverter",

 "key.converter":"org.apache.kafka.connect.converters.ByteArrayConverter",

 "prefix":""

 }

}' -k -u ic\_kc\_user:&lt;ic-kc-password&gt;



   

 

 The values for **&lt;s3-bucket-name&gt;**, **&lt;aws-access-key&gt;**, **&lt;aws-secret-key&gt;** and **&lt;ic-kc-password&gt;** are the same as the values used for configuring the s3 sink connector previously.

### Configuring Kafka Console Consumer

We now use a console consumer to read the messages which are sent back through Kafka by our Bundled S3 Source Connector.

Instructions to set up a console consumer can be found in the Kafka cluster’s ‘CLI’ examples in the console, next to the ‘Topic Management’ examples we visited earlier for setting up our topics. The console consumer should be set to read from the “**restored-S3TestTopic**”. As you type messages into the console producer, they will be sent through both of the S3 bundled plugins and reappear in the console consumer.

Congratulations, you have successfully connected a Kafka cluster to an AWS storage bucket using Kafka Connect and Instaclustr’s S3 plug in.

 

 [ Previous ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/troubleshooting-your-kafka-connectors/)Troubleshooting your Kafka connectors

 

 

 [ Next ](https://instaclustr.husldigital.com/support/documentation/kafka-connect/using-kafka-connect/using-kafka-mqtt/)Tutorial: Using Kafka with MQTT

 

 

 

 

 

 



 

 Need support?

 [Learn more](https://support.instaclustr.com/hc/en-us/requests/new) 

 

Experiencing difficulties on the website or console?

 [See the status page](https://status.instaclustr.com/?_gl=1*qj87gm*_gcl_au*MTYxNTg3NTY5Ny4xNzM1NTI0ODMzLjE4OTQyMjAxNTYuMTc0MTAxMTI5My4xNzQxMDExMjkz*_ga*MTgxNTY5OTk0NS4xNzEwOTYxMzE1*_ga_4NBQSJMP6D*MTc0MjIyMjAyOC4yNDUuMS4xNzQyMjIzMDUyLjIwLjAuMA..&_ga=2.12354995.628574599.1742218211-1815699945.1710961315) 

 

Already have an account?

 [Log in to the Console](https://console2.instaclustr.com/?_gl=1*qj87gm*_gcl_au*MTYxNTg3NTY5Ny4xNzM1NTI0ODMzLjE4OTQyMjAxNTYuMTc0MTAxMTI5My4xNzQxMDExMjkz*_ga*MTgxNTY5OTk0NS4xNzEwOTYxMzE1*_ga_4NBQSJMP6D*MTc0MjIyMjAyOC4yNDUuMS4xNzQyMjIzMDUyLjIwLjAuMA..&_ga=2.12354995.628574599.1742218211-1815699945.1710961315) 

 

### Need help withyour Cluster?

 [Contact support](https://support.instaclustr.com/hc/en-us/requests/new) 

 

 

  



  Learn about our  
Managed platform
----------------------------------

Schedule your 1:1 session with one of our open source experts

 

 [ Schedule a demo ](/schedule-a-demo/)
