What's the difference/relationship between AVR and Arduino?
AVR is just an integrated circuit microchip, made by Atmel. It looks something like this:
Although they can be used by themselves, it takes a bit of hardware experience and some support components.
The Arduino is an AVR processor running special code that lets you use the Arduino environment to program and upload code easily. All you need is a USB cable to program and communicate with it. It looks something like this:
(source: mitchellpage.com.au)
A breadboard technically looks like this, and can be helpful in doing things with an Arduino. It is not necessarily needed for either solution but it is useful.
If your asking these sorts of questions, you should checkout the Arduino tutorials at adafruit. They're very basic and will teach you what you need to know to get started.
AVR is a processor architecture. It is a design for how the processor should work like x86 and ARM. Atmel sells hardware that has the AVR architecture in 8-,16-, and 32-bit architectures through products like ATTiny, ATMEGA, etc.
Arduino sells boards meant for hobbyist to put something together quickly and with little knowledge of the underlying hardware. These boards usually have ATMEGAs in them.
If you are new to programming at this "hardware" level, I would suggest buying an arduino board. You get a lot of bang for your buck since you don't have to buy breadboards, programmers, power supplies, etc. and it is much easier to work with most of the hardware is soldered onto the board.
AVR is a microcontroller of the ATMEL family, used in Arduino. ARM is a microprocessor. Most of the Arduino Boards come with AVR controllers. Recently Arduino Due has been launched which is based on ARM processor. Hope this is enough to clear-out things between AVR, ARM, Arduino(',')