Opened 9 years ago
Closed 9 years ago
#49854 closed enhancement (fixed)
Build all ports on all buildbot buildslaves
| Reported by: | ryandesign (Ryan Carsten Schmidt) | Owned by: | admin@… |
|---|---|---|---|
| Priority: | Normal | Milestone: | |
| Component: | server/hosting | Version: | |
| Keywords: | Cc: | mojca (Mojca Miklavec) | |
| Port: |
Description
We had some buildbot outages over the past months. Dave scheduled a lot of forced builds that got lost (apparently all queued forced builds get lost except the most recent one). We also ran out of disk space on the packages server, and to make room, packages older than two years were deleted, even if they were still current. So I'd like to build all ports on all buildbot builders to make sure we have a current collection of packages for all platforms.
Current status:
- Snow Leopard: build 38656 aborted after failing to fetch emacs-mac-app due to #49759. Need to start another build for the remaining ports, minus those that have already been done since then.
- Lion: not yet started; still being repaired; see #48486
- Mountain Lion: not yet started
- Mavericks: not yet started
- Yosemite: build 6247 aborted after failing to build gambit-c; don't know why. Need to start another build for the remaining ports, minus those that have already been done since then.
- El Capitan: not yet started; not yet set up; see #48609
Change History (21)
comment:1 Changed 9 years ago by mojca (Mojca Miklavec)
| Cc: | mojca@… added |
|---|
comment:2 Changed 9 years ago by jmroot (Joshua Root)
Replying to ryandesign@…:
- Yosemite: build 6247 aborted after failing to build gambit-c; don't know why.
Sounds like #46013. The blacklisting was adjusted in r141215 and now it would be using macports-clang which AFAIK would have the same problem as system clang.
comment:3 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
New all-ports builds started for:
comment:4 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
Yosemite and El Capitan completed successfully. New build started:
comment:5 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
The Mavericks build finished building, but there was a memory exception when trying to process the log file from the build phase, so subsequent phases, including uploading the packages, did not run:
Starting another all-ports build after the current builds are done should work, and should upload the packages.
comment:7 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
Mavericks build completed successfully.
comment:8 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
Mountain Lion build completed successfully.
comment:10 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
The build aborted while building fife. Retried and it completed (failed, but completed). New all ports build started:
https://build.macports.org/builders/buildports-snowleopard-x86_64/builds/40656
comment:11 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
A memory exception occurred after 67 hours while building org-mode. Retried org-mode by itself which failed with:
command timed out: 1200 seconds without output, attempting to kill
This is an org-mode bug I filed as #50736.
comment:12 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
I've worked around the org-mode bug but we should wait until openssl builds again on Snow Leopard (see #50771) before initiating another all-ports build there.
comment:13 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
comment:14 follow-up: 15 Changed 9 years ago by mojca (Mojca Miklavec)
I have some weird feeling about this. For example:
Building cvs-fast-export (2096 of 19298)...skipping, portfile not modified since last failure
I'm not aware of this port being a dependency of anything else, but it seems as if the buildbot was aware that the port failed to build earlier (due to a failure in openssl) and refused to build it again.
And the log seems to have stopped at
Building org-mode-devel (6200 of 19298)...
so a number of ports are missing.
comment:15 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
Replying to mojca@…:
I have some weird feeling about this. For example:
Building cvs-fast-export (2096 of 19298)...skipping, portfile not modified since last failureI'm not aware of this port being a dependency of anything else, but it seems as if the buildbot was aware that the port failed to build earlier (due to a failure in openssl) and refused to build it again.
Good point. I'll see if I can clear the cache of failed builds before starting a new one.
And the log seems to have stopped at
Building org-mode-devel (6200 of 19298)...so a number of ports are missing.
That's #50736 again. Fixed org-mode-devel the same way I fixed org-mode.
comment:16 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
comment:17 follow-up: 19 Changed 9 years ago by dbevans (David B. Evans)
The latest SL build is progressing but still a lot of "skipping, portfile not modified since last failure" messages. Good examples are the various python ports which failed to build due to the SL openssl problem, now fixed. They'd probably build but they're being skipped now.
A large number of ports failed due to this broken dependency and I expect many, if not all, are in the same boat and would build if given a chance.
Is there any way to disable this "feature"?
comment:18 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
I already renamed the "failcache" folder, assuming that would fix the problem. I'll look into it again once this build finishes.
comment:19 follow-up: 20 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
Replying to ryandesign@…:
https://build.macports.org/builders/buildports-snowleopard-x86_64/builds/40816
It finished building all ports, but predictably crashed after building, and before uploading the packages, while trying to process the large log:
Replying to devans@…:
The latest SL build is progressing but still a lot of "skipping, portfile not modified since last failure" messages. Good examples are the various python ports which failed to build due to the SL openssl problem, now fixed. They'd probably build but they're being skipped now.
A large number of ports failed due to this broken dependency and I expect many, if not all, are in the same boat and would build if given a chance.
All ports depending on openssl were revbumped in r146517. Buildbot is currently working on rebuilding those ports.
https://build.macports.org/builders/buildports-snowleopard-x86_64/builds/40818
When the buildbot is next unoccupied, I'll do another all-ports build to get the packages uploaded.
comment:20 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
Replying to ryandesign@…:
When the buildbot is next unoccupied, I'll do another all-ports build to get the packages uploaded.
https://build.macports.org/builders/buildports-snowleopard-x86_64/builds/40826
comment:21 Changed 9 years ago by ryandesign (Ryan Carsten Schmidt)
| Resolution: | → fixed |
|---|---|
| Status: | new → closed |
Completed successfully. I'm going to call this resolved; Lion will be handled separately.
Cc Me!