To preface my reply, I do not claim any expertise beyond 40 some years of filing as a US citizen non-resident.
Not to put the damper on Jo-Anne's reply, but I don't believe that the IRS gives up that easily. At least this is what they would have you believe. Although you as a Dutch citizen (assuming that you do not have residency, i.e. Green Card) are not liable for taxes in the USA, your husband as a citizen, even a dual national, certainly is. If it comes to that, there are at least 2 or 3 ways that the IRS can get to him: 1) Attach any assets that he may have in the USA, 2) refuse to renew his US passport. One of the explicit reasons that was stated some 10 - 20 years ago when the passport application began to require the social security number was to catch non-compliant US citizens, 3) in extremis they could request the Dutch courts to extradite him for income tax evasion.
You have not stated your incomes, but the tax code as I understand it, allows one to deduct an amount of foreign earned income that has increased each year to arrive at the adjusted gross income and to deduct any foreign taxes paid from US income taxes owed. Assuming that what is owed to the US part is smaller there will indeed be indeed a wash. It is not automatic that you will not owe US taxes. And even if this is the case, there are certainly penalties that can be assessed.
I believe that it would be prudent and sensible to consult a tax specialist with your specifics. I have worked with Steve Horton in Paris who has provided me with sensible and practical advise that has saved me more than I have paid him, but there are certainly other fish in this sea.
On the other hand you can always hope that if after all this time you will continue to enjoy the benign neglect of the US government.