Do you just have a little sign up box on your site that says "email signup" or "newsletter sign up?"
Good lord, man. Stop it. No one is going to want to sign up for that.
Here's a great example I came across today from Turntable Labs. This will get people joining your list!