clamav @0.97_0 +universal Database load killed by signal 11

[palimm@…]

freshclam fails to load new database. Owner permissions on /opt/local/share/clamav are set to "_clamav"
System: 10.7.3 Darwin Kernel Version 10.7.3: Sun Mar 6 13:37:56 PST 2011; root:xnu-1504.14.2~1/RELEASE_X86_64 x86_64 i386
XCode: 4.0.1 (Build 4A1006)

$ sudo freshclam -v
Current working dir is /opt/local/share/clamav
Max retries == 3
ClamAV update process started at Thu Mar 31 09:45:26 2011
Using IPv6 aware code
Querying current.cvd.clamav.net
TTL: 841
Software version from DNS: 0.97
main.cvd version from DNS: 53
main.cvd is up to date (version: 53, sigs: 846214, f-level: 53, builder: sven)
daily.cvd version from DNS: 12933
daily.cvd is up to date (version: 12933, sigs: 87039, f-level: 60, builder: guitar)
Retrieving http://database.clamav.net/bytecode.cvd
Trying to download http://database.clamav.net/bytecode.cvd (IP: 78.47.127.222)
Downloading bytecode.cvd [100%]
Loading signatures from bytecode.cvd
ERROR: Database load killed by signal 11
ERROR: Failed to load new database: No viruses detected
abraxas:~ marc$ sudo freshclam -vvv
Current working dir is /opt/local/share/clamav
Max retries == 3
ClamAV update process started at Thu Mar 31 09:49:07 2011
Using IPv6 aware code
Querying current.cvd.clamav.net
TTL: 620
Software version from DNS: 0.97
main.cvd version from DNS: 53
main.cvd is up to date (version: 53, sigs: 846214, f-level: 53, builder: sven)
daily.cvd version from DNS: 12933
daily.cvd is up to date (version: 12933, sigs: 87039, f-level: 60, builder: guitar)
Retrieving http://database.clamav.net/bytecode.cvd
nonblock_connect: connect timing out (30 secs)
Can't connect to port 80 of host database.clamav.net (IP: 89.149.194.18)
Trying host database.clamav.net (188.40.42.237)...
Trying to download http://database.clamav.net/bytecode.cvd (IP: 188.40.42.237)
Downloading bytecode.cvd [100%]
Loading signatures from bytecode.cvd
ERROR: Database load killed by signal 11
ERROR: Failed to load new database: No viruses detected

[danielluke (Daniel J. Luke)]

I can't replicate this problem with Xcode 3 on 10.6.7 (Universal i386 x86_64).

Did you want to try building non-universal and see if that makes a difference on your system?

Or try running freshclam under gdb and get a backtrace of where the problem is happening?

[palimm@…]

Thanks for your reply. The non-universal build shows no different behavior (don't know why I built universal in the first place). I am not familiar with gdb but I started it using

sudo gdb /opt/local/bin/freshclam

GNU gdb 6.3.50-20050815 (Apple version gdb-1518) (Sat Feb 12 02:52:12 UTC 2011)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "x86_64-apple-darwin"...Reading symbols for shared libraries .....
warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/blocksort.o" - no debug information available for "blocksort.c".


warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/huffman.o" - no debug information available for "huffman.c".


warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/crctable.o" - no debug information available for "crctable.c".


warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/randtable.o" - no debug information available for "randtable.c".


warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/compress.o" - no debug information available for "compress.c".


warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/decompress.o" - no debug information available for "decompress.c".


warning: Could not find object file "/opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_ports_archivers_bzip2/work/bzip2-1.0.6/bzlib.o" - no debug information available for "bzlib.c".

.... done

(gdb)

Then I "run" the program which resulted in

Starting program: /opt/local/bin/freshclam 
Reading symbols for shared libraries .++++++++ done
Reading symbols for shared libraries .. done
ClamAV update process started at Fri Apr  1 19:23:32 2011
main.cvd is up to date (version: 53, sigs: 846214, f-level: 53, builder: sven)
daily.cvd is up to date (version: 12939, sigs: 92799, f-level: 60, builder: ccordes)
nonblock_connect: connect timing out (30 secs)
Can't connect to port 80 of host database.clamav.net (IP: 89.149.194.18)
Downloading bytecode.cvd [100%]
ERROR: Database load killed by signal 11
ERROR: Failed to load new database: No viruses detected

Program exited with code 067.
(gdb)

Issuing "bt" afterwards just returned "No stack."

[palimm@…]

Setting "Bytecode" to "no" in freshclam.conf makes the database update correctly. Reenabling it returns the error.

[danielluke (Daniel J. Luke)]

That's interesting.

Can you attach the output of:

sudo port clean clamav
sudo port -dv test clamav

There could be a bug in the clamav bytecode engine when compiled by Xcode 4 (which we'll want to get patched upstream).

[palimm@…]

output of: sudo port clean clamav / sudo port -dv test clamav

[palimm@…]

Has the output been of any help ?

[danielluke (Daniel J. Luke)]

Either there is something wrong with macports trac, or the file you uploaded doesn't contain the output (when I un-zip it, I get a MacPorts html file).

[palimm@…]

Use the little symbol next to the filename to download. It points to a different "version" as it seems.

[danielluke (Daniel J. Luke)]

Ok, well, it looks like all of the tests pass - so I don't see anything obvious.

Does Xcode4 ship with the compiler from Xcode3 as well? We could force using that compiler which should fix the issue (for now). This is probably something that we should report upstream so that it gets fixed there too.

[palimm@…]

It has

a) i686-apple-darwin10-gcc-4.2.1 (GCC) 4.2.1 (Apple Inc. build 5666) (dot 3)

b) i686-apple-darwin10-llvm-gcc-4.2 (GCC) 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2335.9)

[danielluke (Daniel J. Luke)]

OK, presumably llvm-gcc is the default compiler with Xcode4 and that's what is causing the problem.

I'll see if I can figure out the correct portfile magic to make it use gcc (build 5666) [which is the same compiler as Xcode3]

[danielluke (Daniel J. Luke)]

Can you verify that that hypothesis is correct?

(check and see if /usr/bin/gcc-4.2 is llvm-gcc with Xcode4?)

[palimm@…]

I don't think so.

/usr/bin/gcc-4.2 --version
i686-apple-darwin10-gcc-4.2.1 (GCC) 4.2.1 (Apple Inc. build 5666) (dot 3)

[danielluke (Daniel J. Luke)]

Ok. I have no idea why I can't replicate the problem you're seeing, then.

[smwardle]

Output from "sudo port -dv test clamav"

[smwardle]

I've just migrated from a 32bit system running 10.6.7 with Xcode3 to 64bit with Xcode4. After reinstalling the ports I was seeing random clamd crashes. /opt/local/share/clamav/bytecode.cld had been copied from the old system. I uninstalled all clamav and deleted /opt/local/share/clamav before installing again. I then hit this same problem when freshclam tried to download bytecode.cld so I've disabled bytecode for now. Attached output from "sudo port -dv test clamav"

[smwardle]

Cc Me!

[smwardle]

Cc Me!

[danielluke (Daniel J. Luke)]

Replying to steve@…:

/opt/local/share/clamav/bytecode.cld had been copied from the old system.

that is pretty likely to cause problems.

I uninstalled all clamav and deleted /opt/local/share/clamav before installing again.

... and that should fix it.

I then hit this same problem when freshclam tried to download bytecode.cld so I've disabled bytecode for now.

That's odd, I can't reproduce that here. Maybe there's a specific bytecode.cld file that is causing the problem? You could try removing it and using freshclam to get a new copy.

I would advise you to report this upstream, as I can't really do anything about it if I can't reproduce the issue.

Attached output from "sudo port -dv test clamav"

... and it looked like all those tests passed (unless I missed something).

[smwardle]

The problem is now that freshclam fails when trying to download bytecode.cvd exactly as reported by palimm@….

[danielluke (Daniel J. Luke)]

... and again, I can't reproduce this, so your options are:

• Debug it and come up with a patch I can include in the macport (and/or upstream)
• report the problem upstream and see if upstream can help debug it (if you go this route, and keep me informed, I can probably include the fix in the macport if there isn't an immediate upstream release with the fix).

[jmroot (Joshua Root)]

There's a ticket about a bug in Xcode 4's linker making valgrind crash. That might be one lead to look into.

[pixilla (Bradley Giesbrecht)]

I had a *nix or Windows (clamwin) system, I don't recall which, where the clam db extension changed and removing all the db's allowed for successful updates.

Have you ran freshclam after removing your current virus databases?

$ ls /opt/local/share/clamav
bytecode.cvd	daily.cvd	main.cvd	mirrors.dat
$ sudo rm /opt/local/share/clamav/*
$ sudo freshclam
ClamAV update process started at Wed May 18 17:14:02 2011
Downloading main.cvd [100%]
main.cvd updated (version: 53, sigs: 846214, f-level: 53, builder: sven)
Downloading daily.cvd [100%]
daily.cvd updated (version: 13089, sigs: 118662, f-level: 60, builder: ccordes)
Downloading bytecode.cvd [100%]
bytecode.cvd updated (version: 143, sigs: 40, f-level: 60, builder: edwin)
Database updated (964916 signatures) from db.us.clamav.net (IP: 208.72.56.53)
Clamd successfully notified about the update.
SubmitDetectionStats: Not enough recent data for submission
$ ls /opt/local/share/clamav
bytecode.cvd	daily.cvd	main.cvd	mirrors.dat