Does calcium supplement help fight against cavities ?

I have about six more cavities that need to be filled, confirmed by dental x-rays. I can't afford to have them ALL fixed right now. I'm wondering if taking calcium supplement (to strengthen my teeth) would slow down the decay caused by the existing cavities.