Definitely get a french press. The next step beyond that for coffee nirvana is a gravity pot which, in my opinion, does produce superior coffee but not a significant enough improvement too justify the added time and expense.
Without spending hundreds of dollars you are not going to be able to get a machine that produces real espresso, let alone great espresso. Inexpensive machines don't generate enough pressure or consistent enough heat.
I can't think of a machine that does both really well. Of course, part of the reason is that I just don't think coffee is made well by machines (see frech presses and gravity pots). One option, however, is just to make a great shot of espresso and dilute with hot water - i.e. make an "americano."
Out_
rien