Your gums bleed as a result of inflammation caused by the presence of bacteria in your mouth. This bacteria, when not properly cleaned off your teeth, will result in an irritation of the gum tissue. This irritation is called gingivitis and will result in red, puffy, and bleeding gums. Gone untreated, it can progress into periodontal disease.