The deployment process¶
1. Services check¶
The Control Panel checks that required services (such as the database) are available.
2. Git check out¶
The project’s Git repository is checked out into a working directory.
3. Build stage¶
Docker builds the application image from the
Dockerfile. Once successfully built, the image is tagged so that it
can be re-used.
The build stage does not have access to environment variables. If environment variables are required as part of the build process, use the ENV command to supply them via the Dockerfile
4. Release commands¶
A container is launched from the image, and any release commands applied will be executed.
(In the case of an Aldryn Django project, the
MIGRATION_COMMANDS setting also applies release commands. This
setting can be populated automatically by Aldryn Addons.)
New containers are launched in parallel, according to the number specified in the project’s subscription.
The application controller tests each container for an HTTP response, for up to 300 attempts.
Each connection test times out after 0.4 seconds.
Once a connection has been established, the test for a positive response (1xx, 2xx, 3xx, 4xx or 500); this times out after 20 seconds.
If any container fails to respond in time or responds with a 5xx server error other than 500, the deployment fails.
Zero-downtime cloud deployments¶
If all of the steps above are successful, then the deployment is marked as successful, and requests will be routed to the new containers, and the old containers will be be shut down. Running containers are never shut down until the new containers are able to respond to requests without errors. This allows us to provide zero-downtime deployments - in the event of a deployment failure, the old containers will simply continue running without interruption.
Differences between cloud deployment and local builds¶
Orchestration: on the cloud the Control Panel manages orchestration; locally, it’s handled by docker-compose according to the docker-compose.yml file.
Services: on the cloud, backing services such as the database and media storage - and if appropriate, optional services such as a message queue - are provided from our cloud infrastructure. Locally, these must be handled differently (for example, your computer doesn’t contain a Postgres cluster or S3 bucket): the database will be provided in a separate Docker container, the media storage will be handled via local file storage, and so on. docker-compose will configure this local functionality.
Docker layer caching on the cloud we don’t cache, locally is used.
Release commands: locally, these need to be executed manually (in Aldryn Django projects, docker-compose run –rm web start migrate can be used to do this)
Notes on Docker image building¶
Docker image/layer caching and re-use¶
Images and image layers are:
not cached in cloud deployments
cached by default in local builds
We don’t use Docker-level layer caching on the cloud because certain cases could produce unexpected results:
Unpinned installation commands might install cached versions of software, even where the user expects a newer version.
Commands such as
apt-get upgradein a Dockerfile could similarly fail to pick up new changes.
Our clustered setup means that builds take place on different hosts. As Docker layer caching is local to each host, this could mean that subsequent builds use different versions, depending on what is in each host’s cache.
When an image is built, even if nothing in the repository has changed, the image may be different from
the previously-built image. Typically, this can affect project dependencies. If a project’s build instructions
specify a component, the installer (which could be
npm) will typically try to install the
latest version of the component, unless a particular version is selected.
This means that if a new version has been released, the next deployment will use that - without warning, and with possibly unexpected results. It is therefore strongly recommended to pin package versions in your project’s installation lists wherever possible to prevent this. (See also Pin all dependencies.)
Image re-use on the cloud¶
In some circumstances, the build process will not build a new image:
If there are no new commits in the repository, and an image has been built already for the Test server, that image will be re-used for the Live server.
When deploying a mirror project, the image already created for the original will be re-used.
Locally, Docker will cache layers by default.
Local image caching can affect components that are subject to regular updates, such as Python packages installed with
pip. In this case, a new version of a component may have been released, but the local build will continue to use an
To turn off this behaviour, use the
--no-cache option with