It really depends on what is on your walls and what you are painting with. The rule is never paint over oil base with latex without priming first.

If your walls are in good shape and are now painted with a water based paint (latex/acrylic) and you plan on using the same then a primer isn't needed. Use use good quality paint and you shouldn't have any problems.