If I recall correctly this can be done by a simple template edit. Use a conditional to check if it's the 5th post, and if it is, add the advertisement postbit to the postbit template.
While those wouldn't be actual posts that are stored as such in the database, this method would actually be better, since it doesn't add a post to the database for each thread.
Unfortunatelly, I can't find the thread to it