informaticsmatters/neo4j Docker 镜像 - 轩辕镜像 | Docker 镜像高效稳定拉取服务

The InformaticsMatters neo4j container image

A specialised build of neo4j used by a number of InformaticsMatters projects.

The repo contains image definitions for our Graph database and a loader that populates the graph from an AWS S3 path.

To build and push...

$ docker-compose build
$ docker-compose push

Typical execution (Docker)

Assuming you have: -

1. A data directory (i.e. ~/neo4j-import) with graph files and a pre-start batch loader script in it called load-neo4j.sh
2. A directory for logs (i.e. ~/neo4j-container-logs)
3. A directory to mount for the generated Neo4j database (i.e. ~/neo4j-container-graph)

...then you should be able to start the database with the following docker command: -

$ docker run --rm \
    -v $HOME/neo4j-import:/data-import \
    -v $HOME/neo4j-container-logs:/graph-logs \
    -v $HOME/neo4j-container-graph:/graph \
    -p 7474:7474 \
    -p 7687:7687 \
    -e NEO4J_AUTH=none \
    -e NEO4J_dbms_directories_data=/graph \
    -e NEO4J_dbms_directories_logs=/graph-logs \
    -e IMPORT_DIRECTORY=/data-import \
    -e IMPORT_TO=graph \
    -e EXTENSION_SCRIPT=/data-import/load-neo4j.sh \
    informaticsmatters/neo4j:3.5.2

Running post-DB cypher commands

The image contains the ability to run a series of cypher commands after the database has started. It achieves this by running a a provided cypher-runner.sh script located in this image's /cypher-runner directory. This script is executed towards the end of the docker-entrypoint.sh and runs in the background until the provided cypher commands have been executed.

All you need to do to run your one early cypher commands is provide them in the either a /cypher-runner/cypher-script.once or /cypher-runner/cypher-script.always file and provide the neo4j credentials.

An example .once script may contain the following index commands: -

CREATE INDEX ON :F2(smiles);
CREATE INDEX ON :VENDOR(cmpd_id);

An example .always script may contain the following cache-warm-up commands: -

CALL apoc.warmup.run(true, true, true);

This command helps improve query performance by quickly warming up the page-cache by touching pages in parallel optionally loading property-records, dynamic-properties and indexes

If the environment variables NEO4J_USERNAME and NEO4J_PASSWORD are defined, the scripts will be run in the background automatically.

The cypher runner waits for a short period of time after neo4j has been given an opportunity to start (about 60 seconds) before the first run of the script is attempted. This can be configured in the image (refer to the cypher-runner script for the environment variables it inspects).

The ansible role and playbook

The Ansible role and corresponding playbook has been written to simplify deployment of the neo4j image along with an associated AWS S3-based graph.

The role deploys an S3-based loader prior to spinning-up the neo4j instance.