Inflation must be brought down to the medium-term target of 4 percent "as quickly as possible" while ensuring rate increases do not hurt the economy drastically, according to Jayanth Varma, one of the three external members on the Reserve Bank of India's (RBI) rate-setting panel.