They cannot penalize you if you pay all taxes owed by tax day for the prior tax year.
Topic No. 306, Penalty for Underpayment of Estimated Tax
www.irs.gov
The United States income tax system is a pay-as-you-go tax system, which means that you must pay income tax as you earn or receive your income during the year. If you didn't pay enough tax throughout the year, either through withholding or by making estimated tax payments, you may have to pay a penalty for underpayment of estimated tax.
I used to think taxes were due on April 15. They are not.
I once tried what you are suggesting, and it worked well for a while. The IRS gives you some leeway, particularly as long as your income is increasing and the amount of withholding is increasing each year. But then one day you get hit with a big penalty and interest. Keep in mind they probably won't do this for several years so the interest compounds.
Bottom line: Not a good idea. Pay them now, whatever use you had for the money for a few short months can wait.
What can you do instead? Tell your employer to withhold less taxes. There is a form for this. Or instead of wages / earned income try to earn money in other ways (business dividends, rents, etc.)
Tax on income is due throughout the year as you earn it.