Install a basic cluster

From the CLI

To start a basic test cluster with three brokers, run the following command on the DC/OS CLI.

dcos package install confluent-kafka

This command creates a new instance with the default name confluent-kafka. Two instances cannot share the same name, so installing additional instances beyond the default instance requires customizing the name at install time for each additional instance.

All dcos confluent-kafka CLI commands have a --name argument allowing you to specify which instance to query. If you do not specify a service name, the CLI assumes a default value matching the package name, confluent-kafka. The default value for --name can be customized via the DC/OS CLI configuration:

dcos confluent-kafka --name=confluent-kafka <cmd>

From the web interface

Alternatively, you can install from the DC/OS web interface. If you install Confluent Kafka from the DC/OS web interface, the dcos confluent-kafka CLI commands are not automatically installed to your workstation. They may be manually installed using the DC/OS CLI:

dcos package install confluent-kafka --cli

After running the package install command, the service will begin installing.

Enterprise DC/OS installation

Depending on the security mode of the Enterprise DC/OS cluster, Enterprise DC/OS users may need to create a custom .json file and use it to install Confluent Kafka.

Create a Configuration File

Create a custom configuration file that will be used to install Confluent Kafka, and save it as config.json. Specify the service account (<service_account_id>) and a secret path (confluent-kafka/<secret-name>) .

{
  "service": {
    "service_account": "<service_account_id>",
    "service_account_secret": "confluent-kafka/<secret-name>"
  }
}

Installing with a custom config file

Use the custom configuration file you just created to install Confluent Kafka with this command:

dcos package install --options=config.json confluent-kafka

Installing with external volumes enabled

Create a custom configuration file that will be used to install Confluent Kafka, and save it as config.json.

{
  "service": {
    "user": "root"
  },
  "node": {
    "external_volume": {
      "enabled": true,
      "driver_name": "pxd",

    }
  }
}

Use the custom configuration file you just created to install Confluent Kafka with this command:

dcos package install --options=config.json confluent-kafka

Service Deployment

To monitor the deployment of your test instance, install the package cli (see command above) and run the command:

dcos confluent-kafka plan status deploy

Once the deploy plan has a status of Complete, the service is fully deployed.

Service Discovery

To connect a client, query the service for its endpoints.

dcos confluent-kafka endpoints

Select an endpoint from the list to see the available connections.

dcos confluent-kafka endpoints <endpoint>

Working with the Service

Using the endpoint information, you can connect a client to the service from within the DC/OS cluster (for example, a Marathon app running a client application). See the other sections of the documentation for more details on configuration, operation, and service capabilities.