To be honest,I really do not know if there is a counter rise time thats a norm.A warmer dough is more easy to work with than a cold one.I would imagine thats up to how your dough behaves cold then warmed up,say an hour to see how it behaves.
That said,With my doughs,I can use them within 15 minutes or so out of the fridge.I basically take them out and by 30 minutes or less,I'm using it to make pizza.I don't have problems with the dough shrinking back when cold.
Basically,as I let the oven warm up,when its HOT,I take the dough out of the fridge,get my sauce,cheese and toppings ready and go ahead and make pizzas.This does not take very long,anywhere from 15-30 minutes,depending on what I have going on.
I will admit,some of my dough that did not sit out very long,still cold,was a little harder to stretch,but it never fought back,and the more I shaped,the more it stretched to size.I believe this happens because I let the dough stay in the machine until done kneading,then I let it rise a bit before putting away for a cold rise for 2 days or so.
Let me back up though...if your dough ball is small,and has not risen much in the fridge,then you may need to let it warm rise longer and let it poof up some as you have been doing.
Most of my doughs dont last pass the 3rd day mark,they will be over risen and over fermented by then.I did compensate by cutting back the yeast somewhat,but I do know its mainly because I let the dough stay in the machine to rise after the cycle is done,before putting away in the fridge.
Sometimes the next day,I may get a dough with a bubble growing on it,and the dough looks ready to go...
I can sometimes pop the bubble with a toothpick and let it sit in the fridge one more day.Sometimes,not so much,it deflates and I have to toss it out.Its rare since I learned how to compensate for how much time I want it to cold rise.
Bottom line is,you will learn what your dough does,depending on how long you mix/knead and how long you cold rise.It took me some time to learn this and now I know exactly what its going to do after I make a dough.