Several ports fail to fetch distfiles when archive exists on server

[ruckonator]

Installing and upgrading ports fail do fetch process not being able to download specified file. The error in the log appears to be garbage text:

I've tried 2 ports and both failed:

openvpn2:

% sudo port install openvpn2                                                                                    
Password:
--->  Computing dependencies for openvpn2
--->  Fetching archive for openvpn2
--->  Attempting to fetch openvpn2-2.4.6_0.darwin_17.x86_64.tbz2 from https://packages.macports.org/openvpn2
--->  Attempting to fetch openvpn2-2.4.6_0.darwin_17.x86_64.tbz2 from http://sea.us.packages.macports.org/macports/packages/openvpn2
--->  Attempting to fetch openvpn2-2.4.6_0.darwin_17.x86_64.tbz2 from http://ywg.ca.packages.macports.org/mirror/macports/packages/openvpn2
--->  Fetching distfiles for openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from https://distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from https://swupdate.openvpn.net/community/releases/
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://sea.us.distfiles.macports.org/macports/distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://ywg.ca.distfiles.macports.org/mirror/macports/distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://ykf.ca.distfiles.macports.org/MacPorts/mpdistfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://cjj.kr.distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://mse.uk.distfiles.macports.org/sites/distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://lil.fr.distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://aarnet.au.distfiles.macports.org/pub/macports/distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://nue.de.distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://nou.nc.distfiles.macports.org/pub/macports/distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://fco.it.distfiles.macports.org/mirrors/macports-distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://kmq.jp.distfiles.macports.org/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from https://pek.cn.distfiles.macports.org/macports/distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from https://sha.cn.distfiles.macports.org/macports/distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://jog.id.distfiles.macports.org/macports/distfiles/openvpn2
--->  Attempting to fetch openvpn-2.4.6.tar.xz from http://jnb.za.distfiles.macports.org/distfiles/openvpn2
Error: Failed to fetch openvpn2: b™—
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_net_openvpn2/openvpn2/main.log for details.
Error: Follow https://guide.macports.org/#project.tickets to report a bug.
Error: Processing of port openvpn2 failed

python37:

--->  Computing dependencies for python37
--->  Fetching distfiles for python37
--->  Attempting to fetch Python-3.7.0.tar.xz from https://distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from https://www.python.org/ftp/python/3.7.0/
--->  Attempting to fetch Python-3.7.0.tar.xz from http://sea.us.distfiles.macports.org/macports/distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://ywg.ca.distfiles.macports.org/mirror/macports/distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://ykf.ca.distfiles.macports.org/MacPorts/mpdistfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://cjj.kr.distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://mse.uk.distfiles.macports.org/sites/distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://lil.fr.distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://aarnet.au.distfiles.macports.org/pub/macports/distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://nue.de.distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://nou.nc.distfiles.macports.org/pub/macports/distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://fco.it.distfiles.macports.org/mirrors/macports-distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://kmq.jp.distfiles.macports.org/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from https://pek.cn.distfiles.macports.org/macports/distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from https://sha.cn.distfiles.macports.org/macports/distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://jog.id.distfiles.macports.org/macports/distfiles/python37
--->  Attempting to fetch Python-3.7.0.tar.xz from http://jnb.za.distfiles.macports.org/distfiles/python37
Error: Failed to fetch python37: N±‡Û
Error: See /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_python37/python37/main.log for details.
Error: Problem while installing python37
Error: Follow https://guide.macports.org/#project.tickets to report a bug.

Here is a snippet of the log /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_lang_python37/python37/main.log

:debug:fetch Executing org.macports.fetch (python37)
:info:fetch --->  Python-3.7.0.tar.xz does not exist in /opt/local/var/macports/distfiles/python37
:notice:fetch --->  Attempting to fetch Python-3.7.0.tar.xz from https://distfiles.macports.org/python37
:debug:fetch Fetching distfile failed: ^PN±<U+0087>Û^?
:notice:fetch --->  Attempting to fetch Python-3.7.0.tar.xz from https://www.python.org/ftp/python/3.7.0/
:debug:fetch Fetching distfile failed: ^PN±<U+0087>Û^?
:notice:fetch --->  Attempting to fetch Python-3.7.0.tar.xz from http://sea.us.distfiles.macports.org/macports/distfiles/python37
:debug:fetch Fetching distfile failed: ^PN±<U+0087>Û^?

[ryandesign (Ryan Carsten Schmidt)]

Replying to ruckonator:

The error in the log appears to be garbage text:

Error: Failed to fetch openvpn2: b™—

Error: Failed to fetch python37: N±‡Û

:debug:fetch Fetching distfile failed: ^PN±<U+0087>Û^?

I agree, the errors appear to be garbage. I don't know why that's happening, and I also don't know why you can't fetch the files, since the files are there on the servers.

[ruckonator]

I have been able to download the distfiles manually and run the install successfully. What is the best way for me to debug the download?

[mf2k (Frank Schima)]

What is the output of the the following?

$ port version

$ port diagnose

[jmroot (Joshua Root)]

Using something like wireshark or tcpflow to look at what is happening at the network traffic level would likely be informative.

[ryandesign (Ryan Carsten Schmidt)]

But whatever network problem might exist, we would expect to get a reasonable error string from curl. The fact that we're getting garbage instead suggests either a bug in libcurl or a bug in the way MacPorts is using it.

[ruckonator]

I ran selfupdate followed by upgrade outdated. Just as mysteriously as the problem appeared, it disappeared. I'm not sure how it resolved itself. If it does come back I will run version and diagnose.

Thanks!

[jmroot (Joshua Root)]

OK, please reopen if you figure out how to reproduce the issue.