An infected tooth sometimes cause bad breath. If it is the gums that have gotten infected, then the tooth may feel a little shaky, or even break in very tiny splinters. Yellow, brown, black spots may appear on the infected tooth. When the problem is left unattended, it can turn severe and form an abscess.