The business has closed do I still owe this bill?

If you were in business January 1 of the previous year (i.e. 1/1/23 for FY2024) you are responsible for the bill.