When I started to get involved with VPS, it was the heyday of BuyVM. I stayed up in the middle of the night to grab their $15 annual payment. I am still very excited when I think about it now.
BuyVM: $3.5/month KVM-1GB/20G SSD/Unlimited New Jersey & Luxembourg