You are doing what they used to sentence convicts to do for hard labor. Sounds like you've sentenced yourself to 3 years at hard labor. Of course convicts get free room and board for the labor and you don't even get that.
Other than wire brushing, lay them all out and sand blast them. Roll them over and do it again. That may be the quickest route.
Brick was made in a kiln to start with but a word or warning though. Fire damaged brick may become soft and brittle and may not be useable again. Show some to an old local bricklayer before you serve your 3 year sentence in vain.