X uses its own locale files to specify locale-specific things, and even worse its own shared libraries to implement them.
The --with-xlocale flag allows you to pack those files. Of course if the application you are about to pack is not an X application, there is no point in using --with-xlocale.