“The line between patience and inaction is hard to determine”