cctools @870: Checksum (rmd160) mismatch for cctools-870.tar.gz

[john.qingwang@…]

The error occurs after migration from MacOS X Yosemite to MacOS X El Captain. sudo port clean cctools was attempted but failed to resolve the problem.

[ryandesign (Ryan Carsten Schmidt)]

Did you read wiki:FAQ#checksums and attempt to figure out which situation applies in your case?

[john.qingwang@…]

Replying to ryandesign@…:

Did you read wiki:FAQ#checksums and attempt to figure out which situation applies in your case?

Thanks for the reply. I did try all the suggestions but the second one. If I managed to get the complete file of cctools from a machine with MacOS Yosemite, how could I install it?

Thank you!

[john.qingwang@…]

It turns out to be that port is looking for cctools-870_0+llvm35.darwin_15.x86_64.tbz2 which seems to be unavailable yet.

[Hot-Wire@…]

I'm having the same issue after the El Capitan upgrade, during the mass reinstall required by MacPorts migration. I also had this issue prior to the upgrade, while still running Yosemite, but decided to deal with it post-upgrade (since migration forces uninstallation anyway).

$ sudo port selfupdate
--->  Updating MacPorts base sources using rsync
MacPorts base version 2.3.3 installed,
MacPorts base version 2.3.3 downloaded.
--->  Updating the ports tree
--->  MacPorts base is already the latest version

The ports tree has been updated. To upgrade your installed ports, you should run
  port upgrade outdated
$ sudo port clean --dist cctools
--->  Cleaning cctools
$ sudo port install cctools
--->  Computing dependencies for cctools
--->  Fetching archive for cctools
--->  Attempting to fetch cctools-870_0+llvm35.darwin_15.x86_64.tbz2 from http://packages.macports.org/cctools
--->  Attempting to fetch cctools-870_0+llvm35.darwin_15.x86_64.tbz2 from http://lil.fr.packages.macports.org/cctools
--->  Attempting to fetch cctools-870_0+llvm35.darwin_15.x86_64.tbz2 from http://nue.de.packages.macports.org/macports/packages/cctools
--->  Fetching distfiles for cctools
--->  Attempting to fetch ld64-242.tar.gz from http://opensource.apple.com/tarballs/cctools
--->  Attempting to fetch ld64-242.tar.gz from http://opensource.apple.com/tarballs/ld64
--->  Attempting to fetch cctools-870.tar.gz from http://opensource.apple.com/tarballs/cctools
--->  Verifying checksums for cctools                                           
Error: Checksum (rmd160) mismatch for cctools-870.tar.gz
Error: Checksum (sha256) mismatch for cctools-870.tar.gz
Error: org.macports.checksum for port cctools returned: Unable to verify file checksums
$ shasum -a 256 /opt/local/var/macports/distfiles/cctools/cctools-870.tar.gz 
81a12e325255ea683447aff5f4d93f53e2498edcfdd4bb43996a21ef7f00b267  /opt/local/var/macports/distfiles/cctools/cctools-870.tar.gz
$ tar xzf /opt/local/var/macports/distfiles/cctools/cctools-870.tar.gz
$ ls cctools-870/
total 80
-rw-r--r--   1 desimone  staff  19829 Mar 19  2013 APPLE_LICENSE
-rw-r--r--   1 desimone  staff  16171 Aug 26 00:49 Makefile
-rw-r--r--   1 desimone  staff    637 Mar 19  2013 PB.project
drwxr-xr-x  18 desimone  staff    612 Sep 30 01:50 ar/
drwxr-xr-x  82 desimone  staff   2788 Sep 30 01:50 as/
drwxr-xr-x   4 desimone  staff    136 Sep 30 01:50 cbtlibs/
drwxr-xr-x   5 desimone  staff    170 Sep 30 01:50 efitools/
drwxr-xr-x  18 desimone  staff    612 Sep 30 01:50 gprof/
drwxr-xr-x  16 desimone  staff    544 Sep 30 01:50 include/
drwxr-xr-x  64 desimone  staff   2176 Sep 30 01:50 ld/
drwxr-xr-x  18 desimone  staff    612 Sep 30 01:50 libmacho/
drwxr-xr-x  41 desimone  staff   1394 Sep 30 01:50 libstuff/
drwxr-xr-x  46 desimone  staff   1564 Sep 30 01:50 man/
drwxr-xr-x  23 desimone  staff    782 Sep 30 01:50 misc/
drwxr-xr-x  34 desimone  staff   1156 Sep 30 01:50 otool/

The file does not appear to be corrupt.

I have downloaded cctools-master.zip from ​https://github.com/opensource-apple/cctools (the only other source for this I could find on Google that wasn't Apple's version or this bug report) and it matches Apple's version exactly.

Apple's site (​http://www.opensource.apple.com/tarballs/cctools/) does not seem to provide checksums.

Not sure how to proceed. I have no reason to suspect corruption, foul play, not the OS upgrade. A stealth tarball regeneration on Apple's part seems the most likely case.

P.S. the one time I've been able to successfully install was pre-upgrade, when MacPorts found a cctools-870_0+llvm35.darwin_14.x86_64.tbz2 binary and skipped building from source. (The pre-upgrade build failure was trying to fetch cctools-870_0+llvm32.darwin_14.x86_64.tbz2 and failing. It was insisting on the llvm32 variant because that's what some prior version used and you have to manually uninstall and reinstall all dependencies to change the variant.)

[Hot-Wire@…]

Cc Me!

[Hot-Wire@…]

earlier tarball

[Hot-Wire@…]

I attached a tarball I found on another machine that was able to install cctools. I haven't had a chance to test it or diff it.

$ shasum -a 256 cctools-870.tar.gz 
b83f4b4696414b814cc1781ec4b68ff9c7bb97920a68f308351a74e75f41d961  cctools-870.tar.gz

[captainproton1971 (Captain Proton)]

Cc Me!

[bukczynski@…]

Cc Me!

[Hot-Wire@…]

• Updated to MacPorts 2.3.4 via port selfupdate.
  • cctools still failed to build due to checksum error.
• Replaced /opt/local/var/macports/distfiles/cctools/cctools-870.tar.gz with attachment noted in comment 6.
  • cctools successfully built.
• Compared the two tarballs. Difference in size of 41 bytes.
• Unpacked both old and new tarballs. Comparing them with diff -r detected no differences.
• Dumping tarball directories with tar tzf and comparing with diff detected no differences.

Not sure what else to throw at this to convince folks it's a stealth change on Apple's part, and not user error or corruption. There doesn't seem to be any user-side corrective action that can be taken either, except replacing the tarball with the one above. Can you just update the port checksums to the current file?

[jeremyhu (Jeremy Huddleston Sequoia)]

I need to first make sure that these stealth updates stop happening.

[jenstroeger (Jens Troeger)]

Cc Me!

[ballapete (Peter "Pete" Dyballa)]

Cc Me!

[ryandesign (Ryan Carsten Schmidt)]

Replying to john.qingwang@…:

It turns out to be that port is looking for cctools-870_0+llvm35.darwin_15.x86_64.tbz2 which seems to be unavailable yet.

At this time, that is normal. We do not have a buildbot builder set up for El Capitan yet, so there are no binaries of any ports for darwin_15 yet. See #48609.

[schnide (Joe Schnide)]

Cc Me!

[jenstroeger (Jens Troeger)]

At this time, that is normal. We do not have a buildbot builder set up for El Capitan yet, so there are no binaries of any ports for darwin_15 yet. See #48609.

Does this mean people will be blocked until the buildbot comes alive? When will that be?

[Hot-Wire@…]

Replying to jens.troeger@…:

At this time, that is normal. We do not have a buildbot builder set up for El Capitan yet, so there are no binaries of any ports for darwin_15 yet. See #48609.

Does this mean people will be blocked until the buildbot comes alive? When will that be?

No, they'll be blocked until jeremyhu "make[s] sure that these stealth updates stop happening."

All the buildbot means is that you'll have to build ports from source instead of installing prebuilt binary packages. The buildbot is going to have the same checksum failure as we do unless they either patch in the old tarball and prevent updates to the new one, or change the checksums to match the new version. Presence or absence of the buildbot is not a factor.

[bmayer@…]

Cc Me!

[bmayer@…]

Replying to bmayer@…:

Cc Me!

I am also having the issue. For sure not only El Capitan as I am on 10.9.5.

[jeremyhu (Jeremy Huddleston Sequoia)]

r140775

Hopefully this won't happen again...

[essandess (Steve Smith)]

cc me on 10.10.5.

port clean --dist and all the other tricks failed to resolve the issue.

[Hot-Wire@…]

Replying to s.t.smith@…:

cc me on 10.10.5.

port clean --dist and all the other tricks failed to resolve the issue.

You'll be fine as soon as the fix propagates. The issue is not OS version dependent.

[essandess (Steve Smith)]

Replying to jeremyhu@…:

r140775

Hopefully this won't happen again...

I don't believe this is fixed -- I'm seeing the exact same problem after I do this FOLLOWING your post:

sudo port -d selfupdate
sudo port clean --dist cctools
sudo port install -s cctools
sudo port clean --dist cctools
sudo port upgrade outdated

All this fails with the error:

--->  Computing dependencies for cctools
--->  Verifying checksums for cctools
Error: Checksum (rmd160) mismatch for cctools-870.tar.gz
Error: Checksum (sha256) mismatch for cctools-870.tar.gz
Error: org.macports.checksum for port cctools returned: Unable to verify file checksums

The hashes in the Portfile are:

less `port file cctools`

checksums
                        cctools-870.tar.gz \
                        rmd160  21cfe0e5f14f4a16f198a9f52ed5e133b01ae3a2 \
                        sha256  b83f4b4696414b814cc1781ec4b68ff9c7bb97920a68f308351a7

[essandess (Steve Smith)]

Replying to jeremyhu@…:

r140775

Hopefully this won't happen again...

The hashes in the Portfile conflict with the file available from Apple at ​http://opensource.apple.com/tarballs/cctools/cctools-870.tar.gz:

$ openssl rmd160 cctools-870.tar.gz 
RIPEMD160(cctools-870.tar.gz)= 1e3a2c0b8227ed1462e8097d8f99fb1af803d834
$ openssl sha256 cctools-870.tar.gz 
SHA256(cctools-870.tar.gz)= 81a12e325255ea683447aff5f4d93f53e2498edcfdd4bb43996a21ef7f00b267

[essandess (Steve Smith)]

Replying to Hot-Wire@…:

Replying to s.t.smith@…:

cc me on 10.10.5.

port clean --dist and all the other tricks failed to resolve the issue.

You'll be fine as soon as the fix propagates. The issue is not OS version dependent.

Oh there it is. Thank you! Fixed for me now.

[john.qingwang@…]

The issue seems to be resolved for me by following

sudo port -d selfupdate
sudo port clean --dist cctools
sudo port install -s cctools

Thank you!