You can save any type of files you want to a memory stick. It really doesn’t matter. However, remember that the PSP can only recognize/read certain formats stored in certain locations. It will ignore all other file types.
It might be able to read more file formats in the future, but this depends on future firmware releases.