If the government spends more money, but doesn't increase taxes, they have to borrow money from other countries in order to spend it. If we borrow money from other countries, then our country owes their country. When we owe something, that is called debt.