Pasting image into Outlook results in an attachment, rather than inline with content

This is most likely because the image is copied from File Explorer. It will then be added as an attachment instead of embedded in the text.

To verify that your Outlook is working as intended try using the PrtScrn button and then Ctrl + V in Outlook. If the file is added directly then everything is working as intended. There is no way to copy a picture directly from File Explorer and have it embedded.

If you want to embed a picture you have already saved in File Explorer, open it in Paint > Copy the picture > paste into Outlook.

To insert a picture from a file:

1. In an open message, on the Insert tab, click Picture.
2. Browse to locate the picture that you want to insert.
3. Click the picture you want, and click Insert.

NOTE: Microsoft Outlook automatically embeds pictures in a message. You can reduce the size of your email by linking to the picture. In the Insert Picture dialog box, click the arrow next to Insert, and click Link to File.

Source: https://support.office.com/en-in/article/Insert-a-picture-or-clip-art-to-an-email-message-in-Outlook-2013-7a0be50d-6034-4b6d-93da-6de876a0510e#__toc301420133

You have two options, but still a bit "clicky":

1. Open your image file with "mspaint" or any other image editor. Copy the image from there and paste into Outlook.

2. Open the image file normally, copy the image and paste into Word - then copy from Word and paste into Outlook.