Inductor vs a capacitor
To answer this properly, you should know the properties of a capacitor and an inductor.
Inductors are one of the primary components required by a switching regulator. A capacitor and an inductor are similar in the way that a capacitor resists a change of a voltage and an inductor resists a change in current. The "strength" of their resistance depends on their value
Capacitors are widely used to clean up a power supply line, i.e. remove noise or ripple at (higher) frequencies. Inductors are used in switching power supplies where a relatively constant current is passed through an inductor. A switching power supply works in that a switch is opened and closed very quickly. When the switch is closed, the inductor is 'charged'. When the switch is open, the energy is drawn from the inductor into the load. Usually such a power supply is being decoupled with a capacitor to create a stable power supply line.
An inductor is required to make this principle work. If you know a resistor that has an equal resistance for all frequencies of signal, you should view a capacitor as a resistor that will be infinite for DC (0Hz) and 0 for high frequencies. An inductor will be the opposite: it's resistance will be 0 at 0Hz, and infinite at high frequencies. However we don't call this resistance (that's only used for a pure resistor!) but impedance.
A PC motherboard or graphics card is basically not much else than this. They have their main chips and the routing between them, and most other components are power supply or a little bit of interfacing between chips or connectors.
The basic electrical property of a capacitor is that the voltage across a capacitor cannot change instantaneously, whereas the basic property of inductance is that the current through an inductor cannot change instantaneously. Capacitors preserve voltage by storing energy in an electric field, whereas inductors preserve current by storing energy in a magnetic field.
One result of this is that while capacitors conduct best at higher frequencies, inductors conduct best at lower frequencies. Another result is that if you put an AC current through a capacitor, the voltage will lag behind the current by some phase angle that depends on the capacitance and the frequency - capacitors inhibit changes in voltage. Meanwhile if you put an AC voltage across an inductor, the current will lag behind the voltage by a phase angle that depends on the inductance and the frequency - inductors inhibit changes in current.
In some situations, inductors and capacitors can substitute for each other. In others, they cannot. Of course, they never directly substitute. What this means is that some circuits can be slightly modified so that an inductor is used instead of a capacitor or vice versa to achieve the same purpose. Some circuits cannot.
An inductor does not store a charge in its magnetic field, but rather energy. When the magnetic field is allowed to collapse, the inductor will spontaneously generate a voltage. The voltage is usually much higher than any voltage which was previously applied to the inductor. A capacitor will never exhibit a voltage which is greater than what was applied to it. So for instance, a capacitor cannot be used to build an ignition coil for a gasoline engine.
A capacitor in series is similar to an inductor in parallel, in some ways. Both approaches can make a filter with the same frequency response. However, the loading effects of these circuits are not the same. A capacitor in series blocks DC, and so to a DC source, it looks like an infinite impedance: the lightest possible load. An inductor in parallel is the exact opposite: a short circuit. The two only look similar from the perspective of the load device: it sees a signal that has been high-pass-filtered, and is free of DC. But the DC is not removed in the same way. Blocking a signal with an open load is not the same as short-circuiting a signal to ground.
Likewise, an inductor in series is similar to a capacitor in parallel, but again, the loading effect is not the same. We can use a capacitor to prevent AC, or AC above certain frequencies, from entering a circuit, by shunting those signals to the return. Sometimes that is acceptable, like when blocking RF noise from entering a device. In some other cases, shunting AC to ground may create an unacceptable load on the source of that signal. An inductor can block AC by creating a high impedance against it.
So even in circuits where we can potentially substitute parallel inductors for series capacitors and vice versa, consideration for the loading differences may require us to choose one or the other.