the only real problem is the angle or the overhang, you can't have both on a large scale. your second picture is actually fine, real formations like that exist. Although the placement of the river makes no sense, a river is not going to stay on top of the hardest rock around, which it has to be to erode into that shape, it will be on one side or the other.
Entire forests of ridiculously sharp vertical stone spikes already exist, it is called Grand Tsingy, another is the common hoodoo type formation, both shown. The only problem that stone is not terribly stable at an unsupported angle. Basically if the stone is soft enough to erode in to a spike it is not strong enough to hold itself up under tension. Rocks are much stronger under compression than tension and overhangs are under tension. But really the nature of erosion means overhanging rock protects the softer rock belows so even when hard rock forms an angled spike, it really forms a cone with softer rock forming the rest of the shape.


The exception is when wind erodes the lower portion faster than a higher portion, but because of how wind works this happens in all directions, leading to top heavy outcrops or balancing rocks. The weakness of the rock limits this in size and to roughly balanced shapes.

You can get overhangs like you want BUT they only occur in very strong rocks with angled bedding planes, usually with a huge mass of rock to counterbalance the overhang, meaning they are are very rare and limited in size. the closest you will get is in the below image, the Troll's Tongue. Which is impressive but still rather small on the scale of your images. basic rule is the bigger the piece of rock the closer to vertical the angle has to be.

2You can have slanted slopes, but not too much of overhang - that kind of formation will fall in geologically short time. – Alexander – 2019-03-27T19:14:26.797
@Alexander Too short for one of any great size to form, and exist even for a few hundred/thousand years? – SealBoi – 2019-03-27T19:33:16.923
@SealBoi Yeah, the greater the overhang, the shorter the lifespan of the formation. – Arkenstein XII – 2019-03-27T19:47:55.247
1@ArkensteinXII And I assume that the rock formations would have to be pushed out slowly such that the visible spike "grew larger"? – SealBoi – 2019-03-27T19:51:28.173
1@SealBoi Actually, something like that would be more likely to be an erosionary feature. It could be a remnant of a sedimentary sequence that is mostly gone now. – Arkenstein XII – 2019-03-27T19:56:36.147
List of rock formations, list of rock formations in the U.S.A.; e.g., the Vasquez Rocks. Structures as shown in the pictures (assuming they are meant to be big, say more than a few meters long) cannot exist. Rocks do not have spectacular strength in tension, so that you cannot have a big great pointy rock jutting sideways without support, not even as part of an artificial structure -- it will simply break off. – AlexP – 2019-03-27T22:08:25.037