Silver price rallied to a fresh all-time high on Friday as a slump in Chinese inventories heightened supply concerns.