curl-ca-bundle: fetch failed

[vkuznet (Valentin Kuznetsov)]

Hi, I experience the following problem

--->  Computing dependencies for curl-ca-bundle
--->  Fetching distfiles for curl-ca-bundle
--->  Attempting to fetch certdata-1.87.txt from http://ykf.ca.distfiles.macports.org/MacPorts/mpdistfiles/curl
--->  Attempting to fetch certdata-1.87.txt from http://distfiles.macports.org/curl/
--->  Attempting to fetch certdata-1.87.txt from http://distfiles.macports.org/curl
--->  Attempting to fetch certdata-1.87.txt from http://sea.us.distfiles.macports.org/macports/distfiles/curl
--->  Attempting to fetch certdata-1.87.txt from http://mse.uk.distfiles.macports.org/sites/distfiles.macports.org/curl
--->  Attempting to fetch certdata-1.87.txt from http://lil.fr.distfiles.macports.org/curl
--->  Attempting to fetch certdata-1.87.txt from http://fco.it.distfiles.macports.org/mirrors/macports-distfiles/curl
--->  Attempting to fetch certdata-1.87.txt from http://her.gr.distfiles.macports.org/mirrors/macports/mpdistfiles/curl
--->  Attempting to fetch certdata-1.87.txt from http://aarnet.au.distfiles.macports.org/pub/macports/mpdistfiles/curl
--->  Attempting to fetch certdata-1.87.txt from http://jog.id.distfiles.macports.org/macports/mpdistfiles/curl
--->  Attempting to fetch certdata-1.87.txt from http://cjj.kr.distfiles.macports.org/curl
--->  Attempting to fetch certdata-1.87.txt from http://svn.macports.org/repository/macports/distfiles/curl
Error: org.macports.fetch for port curl-ca-bundle returned: fetch failed
Please see the log file for port curl-ca-bundle for details:
    /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_release_ports_net_curl/curl-ca-bundle/main.log
Error: Unable to upgrade port: 1
Error: Unable to execute port: upgrade py27-curl failed

and here are relevant lines from the main.log

:debug:fetch Fetching distfile failed:: The requested URL returned error: 403
:notice:fetch --->  Attempting to fetch certdata-1.87.txt from http://cjj.kr.distfiles.macports.org/curl
:debug:fetch Fetching distfile failed:: The requested URL returned error: 403
:notice:fetch --->  Attempting to fetch certdata-1.87.txt from http://svn.macports.org/repository/macports/distfiles/curl
:debug:fetch Fetching distfile failed:: The requested URL returned error: 403
:error:fetch org.macports.fetch for port curl-ca-bundle returned: fetch failed
:debug:fetch Error code: NONE
:debug:fetch Backtrace: fetch failed
    while executing
"portfetch::fetchfiles"
    (procedure "portfetch::fetch_main" line 17)
    invoked from within
"$procedure $targetname"
:info:fetch Warning: targets not executed for curl-ca-bundle: org.macports.install org.macports.fetch org.macports.checksum org.macports.extract org.macports.patch org.macports.configure org.macports.build org.macports.destroot
:notice:fetch Please see the log file for port curl-ca-bundle for details:
    /opt/local/var/macports/logs/_opt_local_var_macports_sources_rsync.macports.org_release_ports_net_curl/curl-ca-bundle/main.log

It seems to me that port cannot get certdata-1.87.txt from all available URLs. Thanks, Valentin.

[ryandesign (Ryan Carsten Schmidt)]

Replying to vkuznet@…:

It seems to me that port cannot get certdata-1.87.txt from all available URLs.

I agree, but why? You should be able to verify by visiting those URLs (the distfiles.macports.org ones) that the files do exist there. At least, they are when I look there.

You are getting an HTTP 403 error, which means Forbidden. That's not coming from our server. Perhaps you are accessing the Internet via a proxy or a corporate or other network that's preventing you from accessing our servers?

[vkuznet (Valentin Kuznetsov)]

Hmm, strange. Yes, I can access via URL, but can't get via port command. Also I can upgrade my other port packages and only curl fails. So, it's not my proxy (which I don't have), but rather different issue and may be 403 code is misleading and incorrectly assigned elsewhere.

[ryandesign (Ryan Carsten Schmidt)]

Have you been able to resolve this issue?

[vkuznet (Valentin Kuznetsov)]

Nope, but I verified that it's related to the choice of network I use. If anyone has suggestions how to tweak port command to give me more printout about the problem I'll be happy to try.

[ryandesign (Ryan Carsten Schmidt)]

You could try using wireshark to get a network trace and see exactly what data is going back and forth. I'm not exactly sure how to use wireshark though; it seems like a difficult tool to learn. You can install it using MacPorts, except of course that you'll have to fetch the files manually because of the problem you're experiencing.

Curl, the library MacPorts uses to fetch things from the Internet, also has a trace mode which could be enabled; we'd have to patch MacPorts base to do that (in curl.c​).

[ryandesign (Ryan Carsten Schmidt)]

In any case, I don't think this is a bug in the port, MacPorts base, or our infrastructure.