A slabified window is easy, considering it's a window and windows are hard. Build up a few slabs of varying thicknesses and IDs and you're done.
But it's tedious to set all the thicknesses and IDs, right?
How about a module of slabs preset to the proper settings? Then it's just a matter of option-clicking and magic-wanding each part.
You can arrange the slabs so they resemble a window section to help you remember what's what. And, yes, you can call out the parts with text, too, right.
I put one of these for a 2x6 wall at 3 Resources / Modules / Window Slabify.mod. Other wall types would vary but it's a start.