Dose anyone know if brake pads deteroriate with lack of use....

My 04 WRX hardly get's used so im not sure if the brakes have allways need a big shove to get them to work or if its that im too used to a car with over servioed brakes...

At the moment the car only seems to be used for short journies its then useualy washed then put away for a few weeks....so by the time the cars used again theres usealy sreface rust on the disks...

I'm hopeing after its been used on a long journie the pads will have lost any crap thats on them ,hopefully