gseats/splunk-egis

Supported tags

• 7.0.3,latest- Splunk Enterprise base image https://github.com/splunk/docker-splunk/blob/master/enterprise/Dockerfile
• 6.5.3-monitor - Splunk Enterprise with Docker Monitoring https://github.com/splunk/docker-itmonitoring/blob/master/enterprise/Dockerfile

What is Splunk Enterprise?

Splunk Enterprise is the platform for operational intelligence. The software lets you collect, analyze, and act upon the untapped value of big data that your technology infrastructure, security systems, and business applications generate. It gives you insights to drive operational performance and business results.

This repository contains Dockerfiles that you can use to build https://splunk.com Docker images.

Get started with the Splunk Enterprise Docker Image

If you have not used Docker before, see the https://docs.docker.com/mac/started for Docker.

0. (Optional) Sign up for a Docker ID at [***]

1. Download and install Docker on your system.

2. Open a shell pro*** or Terminal window.

3. Enter the following command to pull the Splunk Enterprise version 7.0.3 image.
   

   bash
   docker pull splunk/splunk
   

4. Run the Docker image.

   bash
   docker run -d -e "SPLUNK_START_ARGS=--accept-license" -e "SPLUNK_USER=root" -p "8000:8000" splunk/splunk
   

5. Access the Splunk instance with a browser by using the Docker machine IP address and Splunk Web port. For example, ``http://localhost:8000%60

See How to use the Splunk Enterprise Docker image for additional example commands.

How to use the Splunk Enterprise Docker image

The following commands can be run from a shell prompt or Docker QuickStart Terminal (on Mac OS X).

Pull an image for version 7.0.3 of Splunk Enterprise from this repository

CODE_TOKEN_2

Pull an image that uses the latest version of Splunk Enterprise from this repository

CODE_TOKEN_3

Start a Splunk Enterprise container and automatically accept the license agreement

This command starts a Splunk Enterprise instance from the Docker container in this repository, accepts the license agreement, and opens TCP port 8000 so that you can access the Splunk instance from your local machine.

CODE_TOKEN_4

Start a Splunk Enterprise container and mount the necessary container volumes

CODE_TOKEN_5

Note:

When using data volumes containers, docker will provision the image required volumes automatically under /var/lib/docker/volumes/...

Please, refer to the link for further information: https://docs.docker.com/engine/tutorials/dockervolumes/#locating-a-volume

Start a Splunk Enterprise container and mount volumes from host

CODE_TOKEN_6

Use entrypoint.sh to execute Splunk commands

You can execute commands in the container by typing in the following command, for example:

CODE_TOKEN_7

To learn about the commands you can use with entrypoint.sh, see https://docs.splunk.com/Documentation/Splunk/latest/Admin/CLIadmincommands in the Splunk documentation.

You can also use entrypoint.sh to configure Splunk services with environment variables. See Basic configuration with environment variables.

Configure the Splunk Enterprise Docker container with https://docs.docker.com/compose/

1. At a shell prompt, create a text file docker-compose.yml if it does not already exist.
2. Open docker-compose.yml for editing.
3. Insert the following block of text into the file.

CODE_TOKEN_8 4. Save the file and close it. 5. Run the docker-compose utility in the same directory.

CODE_TOKEN_9

Configuration

Image Variants

The splunk/splunk image comes in several variants:

splunk/splunk:7.0.3 This is the default Splunk Enterprise image.

splunk/splunk:6.5.3-monitor This image comes with some data inputs activated (e.g., file monitor of docker host JSON logs, HTTP Event Collector, Syslog, etc.). It also includes the Docker app which has dashboards to help you analyze collected logs and docker information such as stats, events, tops, and inspect from your running images.

Data Store

This Docker image has two data volumes:

• /opt/splunk/etc - stores Splunk configurations, including applications and lookups
• /opt/splunk/var - stores indexed data, logs and internal Splunk data

User

All Splunk processes by default runs as the splunk user. The user can be changed by setting the SPLUNK_USER env variable.

Ports

This Docker container exposes the following network ports:

• 8000/tcp - Splunk Web interface
• 8088/tcp - HTTP Event Collector
• 8088/tcp - Splunk Services
• 8191/tcp - Application Key Value Store
• 9997/tcp - Splunk receiving Port (not used by default) typically used by the Splunk Universal Forwarder
• 1514/tcp - Network Input (not used by default) typically used to collect syslog TCP data

This Docker image uses port 1514 instead of the standard port 514 for the syslog port because network ports below 1024 require root access. See http://docs.splunk.com/Documentation/Splunk/latest/Installation/RunSplunkasadifferentornon-rootuser.

Hostname

When you use this Docker image, set a hostname for it. If you recreate the instance later, the image retains the hostname.

Basic configuration with Environment Variables

You can use environment variables for basic configuration of the indexer and forwarder. For more advanced configuration, create configuration files within the container or use a Splunk deployment server to deliver configurations to the instance.

• SPLUNK_ENABLE_DEPLOY_SERVER='true' - Enables deployment server on Indexer.
• SPLUNK_DEPLOYMENT_SERVER='<servername>:<port> - http://docs.splunk.com/Documentation/Splunk/latest/Updating/Configuredeploymentclients. Set deployment server url.
  • Example: --env SPLUNK_DEPLOYMENT_SERVER='splunkdeploymentserver:8089'.
• SPLUNK_ENABLE_LISTEN=<port> - enable http://docs.splunk.com/Documentation/Splunk/latest/Forwarding/Enableareceiver.
  • Additional configuration is available using SPLUNK_ENABLE_LISTEN_ARGS environment variable.
• SPLUNK_FORWARD_SERVER=<servername>:<port> - http://docs.splunk.com/Documentation/Splunk/latest/Forwarding/Deployanixdfmanually data to indexer.
  • Additional configuration is available using SPLUNK_FORWARD_SERVER_ARGS environment variable.
  • Additional forwarders can be set up using SPLUNK_FORWARD_SERVER_<1..30> and SPLUNK_FORWARD_SERVER_<1..30>_ARGS.
  • Example: --env SPLUNK_FORWARD_SERVER='splunkindexer:9997' --env SPLUNK_FORWARD_SERVER_ARGS='method clone' --env SPLUNK_FORWARD_SERVER_1='splunkindexer2:9997' --env SPLUNK_FORWARD_SERVER_1_ARGS='-method clone'.
• SPLUNK_ADD='<monitor|add> <what_to_monitor|what_to_add>' - execute add command, for example to http://docs.splunk.com/Documentation/Splunk/latest/Data/MonitorfilesanddirectoriesusingtheCLI or http://docs.splunk.com/Documentation/Splunk/latest/Data/Monitornetworkports on specific ports.
  • Additional add commands can be executed (up to 30) using SPLUNK_ADD_<1..30>.
  • Example --env SPLUNK_ADD='udp 1514' --env SPLUNK_ADD_1='monitor /var/log/*'.
• SPLUNK_CMD='any splunk command' - execute any splunk command.
  • Additional commands can be executed (up to 30) using SPLUNK_CMD_<1..30>.
  • Example --env SPLUNK_CMD='edit user admin -password random_password -role admin -auth admin:changeme'.

Example

Following is an example of how to configure Splunk Enterprise and the Splunk universal forwarder in Docker.

CODE_TOKEN_10

After this script executes, you can forward syslog data to the udp port of container forwarder (for internal containers only, as Splunk does not publish the port). Data should arrive in Splunk Enterprise and you should see the forwarder registered with the deployment server.

Troubleshoot problems with the image

Basic troubleshooting

If you do not see data when you load the Docker Overview app in the Docker app, confirm that:

• You have started the container with the right environment variables. In particular, you must have the proper access control to the mount points to read the default JSON log files that the docker host collects. See Required Permissions for more detail.
• You have included the necessary volumes for the Docker image.
• Your Docker container has the correct filesystem permissions.

Required Permisssions

The following mount points require special permissions:

• /var/lib/docker/containers: By default, the Docker host only exposes read access to the root user. Read access to the volume could be changed for any users that start the Splunk process.
• /var/run/docker.sock - Requires access to the https://docs.docker.com/engine/reference/api/docker_remote_api/ to collect information such as docker stats, tops, events, and inspect.

Overriding the SPLUNK_USER envrionment variable to an authorized user (such as "root") gives you the required access to the mount points that the Docker app needs to analyze the collected Docker information.

Troubleshoot upgrade problems with docker-compose

If you use docker-compose (or reference an existing volume with docker run) to configure and run your Docker image and the Splunk Enterprise Docker container detects an upgrade after you make a change to docker-compose.yml, complete the following procedure to make the image ignore the upgrade prompt:

0. Open docker-compose.yml for editing.

1. In the Environment: section for the Splunk Enterprise image, add the following line:

   CODE_TOKEN_11

2. Save docker-compose.yml and close it.

3. Run docker-compose up again.

If you still need help

If you still have trouble collecting or analyzing data with the Splunk Enterprise Docker image, use one of the following options:

• Post a question to http://answers.splunk.com
• Join the Splunk Slack channel
• Visit the #splunk channel on EFNet Internet Relay Chat
• Send an email to ***