Opened 3 years ago

Closed 3 years ago

#62946 closed defect (fixed)

buildbot won't fetch from its local distfiles mirror

Reported by: jmroot (Joshua Root) Owned by: ryandesign (Ryan Carsten Schmidt)
Priority: Normal Milestone:
Component: buildbot/mpbb Version:
Keywords: Cc:
Port:

Description

See for example: https://build.macports.org/builders/ports-11_x86_64-builder/builds/31159/steps/install-port/logs/stdio

All our mirrors except distfiles.macports.org are blacklisted on the buildbot, but that too has been removed from the list by [c792d69107dafe324d341408e548eff87e7a356b/macports-ports] on newer OS versions.

Change History (4)

comment:1 Changed 3 years ago by ryandesign (Ryan Carsten Schmidt)

Yes, that's right.

Next month, when our CDN bandwidth resets, I'll reinstate the use of the CDN. We just need to make sure we stay within the free monthly bandwidth/usage limits they've given us, which is not straightforward because they haven't given us any way to see how much of the credit we've used.

Technically on the buildbot worker "distfiles.macports.org" is not the CDN; there's local DNS overrides that point that hostname at the local server. Ideally I would like to tell MacPorts on the buildbot to use a different hostname, like distfiles.internal.macports.net, for getting distfiles, and get rid of the DNS override.

comment:2 Changed 3 years ago by jmroot (Joshua Root)

The point is you should probably un-blacklist at least one of the other mirrors in the meantime, or builds will keep failing when the distfile is no longer available from the upstream site.

comment:3 Changed 3 years ago by ryandesign (Ryan Carsten Schmidt)

Short of explicitly listing each mirror that we want to blacklist, I don't think we have syntax to do that.

I'm working on fixing the problems with master_site_local and patch_site_local that currently prevent them from being used for this; see #62143.

comment:4 Changed 3 years ago by ryandesign (Ryan Carsten Schmidt)

Resolution: fixed
Status: assignedclosed

In b520ede1e3f5546420d57212b7d367f70d393d7c/macports-ports (master):

mirror_sites.tcl: Remove temporary CDN limit

Closes: #62946

Note: See TracTickets for help on using tickets.