I got mine working great.
Cereal Box for gasket material
High temp gasket maker to smear over cereal box material
Time and patience
Used a dremel to round or bore out the lower part of the hole on the intake manifold. Even after doing this the hole on the adapter plate for the IACV still did not line up 'enough'. Then I rounded out part of the adapter hole so that air can rush upwards into the new opening on the intake manifold. Lastly, I made my own gasket so that it can act as a seal to block off the remaining opening in the adapter hole (due to the 06 manifold not having material there). If you don't do this you will have a big vacuum leak. Hope this makes sense. I didn't know if this would work so I didn't snap pics.
BTW, before this I had tried disabling the IACV through KPro and it did not help but thanks to all who suggested to try it.