This is out of context a bit. Ben was arguing against those who felt that the limited (and reciently worsened) freedoms under British rule was better than other options (war with England, between states, other power, Indians, etc). For example, one (but not all) of the reasons we were taxed so much, compared to other servants to the Crown, was due to the costs of the French Indian War. As a matter of finance and lives, they were not sure we could be independant. Many if not most felt, better England then some other power be in charge of their lives. They were worried, as a nation, liberty would cost so much.
I agree with Ben, but I understand the other sides point of view (as did Ben).
You can't take everything our founding fathers wrote to apply to everything. Look at the DOI compated to the Constitution. The "pursuit of happiness" sounded great in the DOI, but when it came to creating a body of laws, happiness did not make the cut.