You will need at least a 6" flue, and maybe at least an 8". Most chimneys for, say, an oil or gas furnace, would use only a 4".
I would, based on your description, say you cannot use it as you hoped. But check with a local pro to see the feasibility.
Good luck (and invite me over for home-made pizza).
© 2016 Renovate Your World LLC