File Explorer is the default on Windows PCs, but it's not the prettiest app for file management. That title goes to Files, a third-party file explorer available on Windows 11 and Windows 10.
This will show you all of the file names of all the files in that location. Type ren "FILENAME.OLD-EXTENSION" "FILENAME.NEW- EXTENSION" with the filename as the name of the file and the old extension ...