I can't believe so many suggested to start with 'C'.
I suggest a scripting language will give a rewarding learning curve.
I suggest that you start with perl as it can be applied across a range of interesting problems and has great functionality. For instance perl modules are extensive.
Python is a superb language too.
C is clearly outstanding, the fastest and the most extensible but I would not recommend it for a beginner.