hate to say it but i would not just glue the dry wall to the insulation. Furring strips or framing the wall would be your best bet for a longer and better job with less hassles in the future
money and time not spent now will get ya in the pocket later.
framing the wall would be my perfered choice and you do not have to fasten it to the concrete wall you can go to the floor joist above ya and glue it to the floor as long as you make it a tight fit
will be alot easier to run your electrical also
in the walls and install outlets