mirror of
https://github.com/vercel-labs/scriptc.git
synced 2026-11-01 07:33:12 +08:00
Chris Tate
4c3a1d9c98
The Linux helpers linked LLVM 22.1.8's release archive. The helper's code generation is LLVM's code, so building that LLVM from its release sources with ThinLTO and with a profile of the helper's own work makes code generation 5-9% faster than the helper as released, with identical objects. - native/llvm-codegen/llvm.profdata.gz is the profile, collected by scripts/refresh-llvm-profile.mjs: it builds LLVM with IR instrumentation and an instrumented helper, and runs that helper on tsc-ts, five Effect fixtures, the runtime benchmark workloads and every 50th corpus program (scripts/llvm-helper-inputs.mjs). It follows LLVM's sources, so it needs a refresh when LLVM is bumped. - scripts/build-llvm-dist.mjs builds LLVM with that profile and ThinLTO, and packs it with a checksum. The llvm-dist workflow, run by hand, builds it for x64 and arm64, requires a helper linked against it to give the same objects as one linked against the release archive (scripts/check-llvm-dist.mjs), prints both helpers' times and the profile's mismatch count, and attaches the archive to the LLVM_DIST_TAG release of this repository. - The release workflow's Linux jobs, and the wasm32-wasi job, which also uploads the x64 GNU helper, download that archive and build the helper with SCRIPTC_LLVM_THINLTO=1: clang, lld and ThinLTO, and the profile for the helper's own sources. Without the archive, or if that build fails, the helper links the release archive as before. - The four Linux helper packages share their build in native/llvm-codegen/linux-helper.mjs. Without SCRIPTC_LLVM_THINLTO it builds the same executable as before.
94 lines
4.4 KiB
YAML
94 lines
4.4 KiB
YAML
name: LLVM distribution
|
|
|
|
# Builds the LLVM that the Linux release helpers link
|
|
# (native/llvm-codegen/llvm-dist.mjs): LLVM from its release sources with
|
|
# ThinLTO and native/llvm-codegen/llvm.profdata.gz, for each Linux
|
|
# architecture. Each job builds a helper against it and one against LLVM's
|
|
# release archive, requires the two to give identical objects on this
|
|
# checkout's helper inputs (scripts/check-llvm-dist.mjs), prints both
|
|
# helpers' times, and attaches the archive to the LLVM_DIST_TAG release.
|
|
# The arm64 build uses the profile collected on x64; its job log reports how
|
|
# many functions the profile no longer matches. Run it after a profile refresh
|
|
# or an LLVM version change, with a new LLVM_DIST_TAG.
|
|
on:
|
|
workflow_dispatch:
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
concurrency: ${{ github.workflow }}
|
|
|
|
jobs:
|
|
build:
|
|
name: Build LLVM (${{ matrix.arch }})
|
|
if: github.repository == 'vercel-labs/scriptc'
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- arch: x64
|
|
runner: ubuntu-24.04
|
|
llvm_asset: LLVM-22.1.8-Linux-X64
|
|
- arch: arm64
|
|
runner: ubuntu-24.04-arm
|
|
llvm_asset: LLVM-22.1.8-Linux-ARM64
|
|
runs-on: ${{ matrix.runner }}
|
|
# About an hour for LLVM on 4 cores, and 5 minutes for each helper link.
|
|
timeout-minutes: 240
|
|
permissions:
|
|
contents: write
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: pnpm/action-setup@v4
|
|
with:
|
|
version: 11.1.3
|
|
- uses: actions/setup-node@v4
|
|
with:
|
|
node-version: "24"
|
|
cache: pnpm
|
|
- name: Install LLVM's release archive and sources
|
|
run: |
|
|
sudo apt-get update
|
|
sudo apt-get install --yes ninja-build zlib1g-dev libzstd-dev
|
|
base=https://github.com/llvm/llvm-project/releases/download/llvmorg-22.1.8
|
|
curl -fL --retry 3 -o "$RUNNER_TEMP/llvm.tar.xz" "$base/${{ matrix.llvm_asset }}.tar.xz"
|
|
tar -xJf "$RUNNER_TEMP/llvm.tar.xz" -C "$RUNNER_TEMP"
|
|
mv "$RUNNER_TEMP/${{ matrix.llvm_asset }}" "$RUNNER_TEMP/llvm-22.1.8"
|
|
curl -fL --retry 3 -o "$RUNNER_TEMP/llvm-src.tar.xz" "$base/llvm-project-22.1.8.src.tar.xz"
|
|
tar -xJf "$RUNNER_TEMP/llvm-src.tar.xz" -C "$RUNNER_TEMP"
|
|
rm "$RUNNER_TEMP/llvm.tar.xz" "$RUNNER_TEMP/llvm-src.tar.xz"
|
|
echo "$RUNNER_TEMP/llvm-22.1.8/bin" >> "$GITHUB_PATH"
|
|
- run: pnpm install --frozen-lockfile
|
|
- run: pnpm --filter @scriptc/compiler --filter scriptc build
|
|
- name: Build the distribution
|
|
run: >-
|
|
node scripts/build-llvm-dist.mjs --source "$RUNNER_TEMP/llvm-project-22.1.8.src"
|
|
--prefix "$RUNNER_TEMP/dist/scriptc-llvm-22.1.8-linux-${{ matrix.arch }}"
|
|
--archive "$RUNNER_TEMP/scriptc-llvm-22.1.8-linux-${{ matrix.arch }}.tar.xz"
|
|
--work "$RUNNER_TEMP/llvm-dist-work"
|
|
- name: Build a helper against each LLVM
|
|
env:
|
|
HELPER: llvm-linux-${{ matrix.arch }}-gnu
|
|
run: |
|
|
LLVM_DIR="$RUNNER_TEMP/llvm-22.1.8/lib/cmake/llvm" pnpm --filter "@scriptc/$HELPER" build:native
|
|
cp "packages/$HELPER/bin/scriptc-llvm-codegen" "$RUNNER_TEMP/helper-release-archive"
|
|
LLVM_DIR="$RUNNER_TEMP/dist/scriptc-llvm-22.1.8-linux-${{ matrix.arch }}/lib/cmake/llvm" \
|
|
SCRIPTC_LLVM_THINLTO=1 pnpm --filter "@scriptc/$HELPER" build:native
|
|
cp "packages/$HELPER/bin/scriptc-llvm-codegen" "$RUNNER_TEMP/helper-profiled"
|
|
- name: Compare the helpers
|
|
run: >-
|
|
node scripts/check-llvm-dist.mjs --baseline "$RUNNER_TEMP/helper-release-archive"
|
|
--candidate "$RUNNER_TEMP/helper-profiled" --rounds 3 --work "$RUNNER_TEMP/llvm-check"
|
|
- name: Attach the archive to the release
|
|
env:
|
|
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
|
|
ARCHIVE: ${{ runner.temp }}/scriptc-llvm-22.1.8-linux-${{ matrix.arch }}.tar.xz
|
|
run: |
|
|
tag=$(node --input-type=module -e "import { LLVM_DIST_TAG } from './native/llvm-codegen/llvm-dist.mjs'; console.log(LLVM_DIST_TAG)")
|
|
# Both architectures' jobs create the release if it is missing.
|
|
gh release view "$tag" > /dev/null 2>&1 ||
|
|
gh release create "$tag" --target "$GITHUB_SHA" --title "$tag" --latest=false \
|
|
--notes "LLVM 22.1.8 built with ThinLTO and the helper profile, for the Linux LLVM helpers (scripts/build-llvm-dist.mjs)." ||
|
|
gh release view "$tag" > /dev/null
|
|
gh release upload "$tag" "$ARCHIVE" "$ARCHIVE.sha256" --clobber
|