Is energy more fundamental than force?

Intuitively, is it right to think of Energy as a more fundamental quantity than Force?

The “fundamental-ness” of something is difficult to quantify so it is hard to say whether something is more or less fundamental. However, I would tend to agree with you, but for different reasons.

There are two basic approaches to classical mechanics. The Newtonian approach is based on forces, and the Lagrangian/Hamiltonian approach is based on energy. In quantum mechanics only the Lagrangian/Hamiltonian approach is used, the Newtonian approach doesn’t apply, and forces can be difficult to define let alone calculate. So insofar as QM is considered more fundamental than Classical Mechanics I think you would consider energy more fundamental than force.

One other point that may lead to the idea of energy being more fundamental than force is that energy is conserved while force is not. Again, fundamental-ness is fairly vague so it is not clear that conservation is a criterion, but it does seem reasonable to consider it briefly.

You mention simplicity, which is not as clear cut as these other points. Some (few) problems are simpler in terms of forces, especially ones with friction. It is good to know forces also for those problems. You can apply Lagrangian methods to dissipative systems, but it is not simple. I think your overall impression is correct, that there are more problems which are simpler in the Lagrangian approach than are simpler in the Newtonian approach.

No, it is false. You have this impression just because you are considering one-dimensional problems where the forces are conservative or they do not produce work. Newton's equation of motion, in this situation, is essentially equivalent to the theorem of mechanical energy conservation. If there are non-conservative forces and/or the motion involves more than one dimension, then the theorem of energy conservation may give some information, but it is by no means sufficient to get the motion of the system.

Let me discuss it for classical mechanics

While Work-Energy mechanics is very powerful, it also has an achilles heel.

A necessary condition for Work-Energy mechanics is that the system is such that an unambiguous potential energy can be defined.

You'd think that you would have to invent a very contrived case to run into that problem. But here is the example given in many textbooks: a ball rolling frictionless on an inclined plate. When you move that ball around, and you return it to the same location as when you started, that ball won't be in the same orientation as when you started. How the orientation of that ball comes out depends on details of how it was moved around.

There is no unambiguous integral for that case, so Work-Energy mechanics cannot solve that case exhaustively.

It's kind of a geometric problem, it tends to be about orientation in one form or another. You need a well-defined integral for the potential energy.

When Work-Energy mechanics cannot solve the case exhaustively you fall back on Force mechanics.

I guess it should be thought of as a trade-off.
Work-Energy mechanics is like a fast car. You get the speed, but there are places where it cannot go. In this analogy Force mechanics is like a tank. It's a lumbering piece of kit, but there is no place where it cannot go.