We dont want to add staff from kiosk app, can we disable this?

Yes, you can disable the Add staff from kiosk app option from Web dashboard > Settings > Kiosk > Kiosk settings > Edit kiosk > untick Add staff option > Save.

Sync the kiosk app once, so it will not be visible on the kiosk device.