what would leave out in a "lightweight" installation? It is possible to remove parts of the software, e.g. printer drivers or color profiles that are not required - or the GUI setup tools, if you install on a server without X-Windows running.
However, such efforts mainly make sense if you do this for several Linux installations, e.g. for a special distro or for embedded use.