MacPorts Meeting 2018: Buildbot

Outstanding issues:

• Buildbot 1.0
  • Can we switch to the new version?
    • TODO: We should prototype builds on Buildbot 1.x and fix the UI rather than working around 0.8's limitations. Depends on #53006.
  • Would offer GitHub authentication

• Deploying www/guide/portindex jobs
  • Has to be deployed by Ryan

• Pull requests
  • Can we test them on our own infrastructure?
  • Requires spinning up clean VMs

• Fixing email notifications
  • No access to logs, Ryan needs to look into it
  • Do not attempt to build ports on platforms they are known to fail on
  • Use 'platforms' option from Portfiles

Most important and might want to start on this meeting:

• Building variants
  • Ticket: #52742
  • Make mpbb support building with variants
  • Which set of variants should be build by the buildbot?
    • +quartz
    • +universal

• History of builds for each port
  • How to find build of a specific port
  • Need to write some kind of index
  • History of builds
  • Display build status on GitHub for each commmit
    • ​https://developer.github.com/v3/repos/statuses/

• Reorganization
  • Use one build job per port
  • Add another level of hierarchy
  • Have a single portwatcher jobs that triggers mirroring and distributes jobs to OS-specific builds afterwards

• Port dependencies build order
  • Ticket: #52766
  • Dependencies need to be built first
  • Sort list of ports to topological order

Issues

​https://trac.macports.org/query?status=!closed&component=buildbot/mpbb

#35897

Add a buildbot with +universal for all packages

#49759

fetch.type {git,bzr} hits buildbot timeout after 20 minutes without output

#51995

buildbot improvements

#51996

Buildbot: create a new factory to aid with new MacPort releases

#52455

Buildbot: use GitHub authentication

#52742

buildbot: add support for building ports with variants

#52810

Enhance buildbot email to include links to failing builds instead of just all builds

#52949

buildbot: list the failed dependencies in DescriptionDone

#52953

buildbot: implement filters of stdio, one for installation, one for dependencies

#52957

buildbot notification mails have wrong To: with non-ASCII encoding

#52983

buildbot: builds with linking errors are not handled properly

#52989

buildbot: allow building 'pseudoports'

#53056

buildbot: multiple failed dependencies reported as multiple broken builds in email report

#53174

buildbot: better handle removal of ports in mpbb

#53250

buildbot: weird handling of conflicting dependencies

#53587

buildbot: portwatcher should not run if portbuilder is still running

#53976

buildbot: provide a way to (force)build just the main port and not its other subports

#53977

buildbot: add a checkbox to add an additional step that runs the test suite

#53978

buildbot: provide a way to rebuild all ports between two commits

#53979

buildbot: merge portwatcher jobs

#55978

buildbot new view implementations

#56017

Buildbot: Replace WithProperties with Interpolate

#56028

Buildbot: Save port version, variants and commit that the port being built belongs to

#56044

Switch to buildbot 2.x

#56045

Buildbot: some members receive no email notifications

#56048

Evaluate replacing getopt with pure-getopt in mpbb to avoid getopt dependency in Travis CI

#56061

Add a lint job

#56314

wine*: The 10.6 i386 builder incorrectly skips building these ports

#57464

Buildbot: Don't keep huge ports installed

#57564

Builds are not always in the right order

#57865

mpbb fails parsing command line options if disk is full

#57869

Don't let the disk fill up

#58800

Buildbot should wait until the clock catches up to the Portfiles

#59286

Mirror distfiles immediately after a commit

#60628

Reduce disk writes

#60632

Reduce disk writes by extracting distfiles directly from fileserver

#60878

Let ports opt in to being built for different deployment targets on buildbot

#60934

sort-with-subports.tcl shouldn't check public server for nondistributable ports

#60995

port_binary_distributable.tcl: Clarify reason for nondistributability

#61019

mpbb: Remove failcache entry if port is already installed

#61862

buildbot jobs: remove MaxCDN zone purge

#62621

mpbb takes too long to install dependencies

#63563

base and buildbots: certificate issues

#65282

CI runs on users' fork without opting-in

#66288

Discussion re pre-built ports for PPC

#66705

Portfile autoupdate: is it possible to setup GitHub actions to avoid manual updates

#67121

collectd has so many default variants that buildbot fails to remove the failcache entry

#67594

build.macports.org: implement simple front-end to display status; including "down for maintenance" (if intentional), or "no response from buildbot infrastructure" (for unanticipated issues)

#67701

Mirror for each build_arch

#67825

Possible to add CI and/or buildbots with GCC (on Intel)?

#67875

Buildbot on Intel tries to build PowerPC ports

#69202

Provide config.log from builders

#69441

Recognize the 0BSD license

#69696

The ports-11_arm64-builder is offline since 3 months

#70038

Add LLGPL license