In the HPS settings of Platform Designer, there is an item to specify the number of chip selects for the QSPI controller.
You need to specify the desired number of chip selects here, recompile the design, and then regenerate the preloader with the generated handoff file.
--------------------
Category: SoC
Tools: SoC EDS
Device: Cyclone® V