No, its a Linux distribution designed for Penetration Testing. Dont try and read too much into the name.
If the attackers happen to be connecting directly to you from their own Internet connection and you log the traffic (firewall/IDS/webserver access log etc) or you do a netstat on the right system at the right time you will be able to get their IP address, but there are lots of ways for the attacker to avoid giving you that much information that easily. Beyond that the issue becomes more complicated and you really need to better understand how the attacks work and the traces they leave...
Probably a good general purpose introduction to this particular subject to get you started would be Cliff Stolls "The Cuckoo's Egg" book, or the shorter online version of the story "Stalking the Wily Hacker"



