Always good to hole punch where your centre is - assuming it's not a flimsy panel, in which case go carefully (like with your pilot drill) and support the back of the panel with a bit of wood to stop panel distortion. Unless those with more experience says this is overkill.What are you trying to drill
Your drill bits are either not hss or they are blunt possibly with no clearance angle and therefore just rubbing..
Sds is more commonly used for masonry.. I don't even know if you can get hss bits for metal with sds shanks.
Invest in some decent hss bitsand there won't be much on a landy you can't drill.. Start small hole where you can then use a larger drill,