Giving up regarding my drivers investigation I've started to look for the cause of my problems in Wicd which I've always found quite capricious.
I've installed networkmanager and nm-applet and right now the connection seems much faster than before.
Wait and see.


