Prime Minister Shinzo Abe was such a proponent of freedom: Former national security adviser