Public sector net borrowing hit $68.7 billion in May, with experts warning of rising unemployment and no guarantee of a strong rebound.