Which report can I look at to check the usage of the DSP Block?

Please refer to the following items in the compilation report.

Fitter ⇒ Resouce Section ⇒ Fixed Point DSP Register Packing Details

--------------------
Category: DSP
Tools: Quartus® Prime
Device: -