I had a similar problem with Broadcom BCM4322. ssb is included in the 2.6.34 kernel and binds to the device before the wl module loads. Google "Manual driver binding and unbinding".
I added the file /etc/modprobe.d/wl (single line)
Where 0000:08:00.0 is the bus id of my card, found as a symbolic link in /sys/bus/pci/drivers/b43-pci-bridge.
install wl echo -n 0000\:08\:00.0 > /sys/bus/pci/drivers/b43-pci-bridge/unbind; /sbin/modprobe --ignore-install wl
And add wl to /etc/modules. This will unbind the ssb driver before loading wl and allow wl to pick it up. No kernel recompile (without ssb) required.