Physical limits means the limits of physics. You can’t go much faster than 4GHz because light only moves 7.5 cm per clock cycle at that speed.