extpython

Isolated python .deb builder

Extpython is a collection of tools for building installable packages containing various versions of Python. The installations are isolated from the operating system's python such that modules may be added, removed, or upgraded without risk of breaking. The builds are executed in Docker.

Example invocation:

./images.sh                      # pulls / creates base images with dependencies
./build.sh trusty-3.9.5.sh       # build using the recipe in the named script file

The vars file - trusty-3.9.5.sh above - contains information about what python version will be built. See src/bionic-3.9.5.sh for an annotated example.

Version support matrix

	2.7	3.13**	3.11	3.10	3.9	3.8	3.7	3.6
Trusty 14.04				3.10.0*	3.9.5*			3.6.7 3.6.8
Xenial 16.04				3.10.0*	3.9.5		3.7.3	3.6.7
Bionic 18.04	2.7.16		3.11.5	3.10.0	3.9.5	3.8.0a4 3.8.0b1	3.7.3	3.6.7
Disco 19.04							3.7.3
Focal 20.04		3.13.0rc3 3.13.0	3.11.5	3.10.0	3.9.5
Jammy 22.04		3.13.0rc3 3.13.0	3.11.5
Noble 24.04	2.7.18	3.13.0rc3 3.13.0	3.11.10

* with provided extpython-openssl packages - see below

** 3.13 and newer are built with and without --disable-gil, and include virtualenv. Gil-less builds have the version number suffixed with t.

Openssl

Some versions of Python require a version of openssl that is newer than what ships on many of these host OSes. To satisfy this requirement, extpython also builds an Openssl package that installs in a similar isolated manner.

See ./ssl/ for details.

Trivia

• Building C extensions won't work unless you install build tools, such as build-essential, development packages, required tools such as pkg-config, etc.

TODO

• Parameter for pre-loaded pip modules

Uploading

curl -v 'http://artifact.scc.net.davepedu.com/addpkg?provider=tar&reponame=cpython&version=3.10.0' -F 'f=@cpython-3.10.0.tar.gz'

rpcli -s http://artifact.scc.net.davepedu.com upload -y apt -f builds/3.10.0/trusty/extpython-python3.10_3.10.0_amd64.deb -r extpython -p extpython-python3.10 -i 3.10.0 -a dist=trusty

Testing

Install extpython in a temporary container an run it.

docker run -it --rm ubuntu:bionic bash

sed -i -E 's/(archive|security).ubuntu.com/aptmirror/' /etc/apt/sources.list && \
sed -i -E 's/^deb-src/# deb-src/' /etc/apt/sources.list && \
apt-get update && \
DEBIAN_FRONTEND=noninteractive apt-get install -y wget gnupg && \
. /etc/lsb-release && \
wget -q -O- http://artifact.scc.net.davepedu.com/repo/apt/extpython/dists/${DISTRIB_CODENAME}/install | bash -x /dev/stdin && \
apt-get install -y extpython-python3.10