In this case, I need to right-click the image, and hover over "Change Picture." Once I've located the replacement image and clicked "Insert," the position and border will remain unchanged.