GLSL is only used in color space conversion and scaling I believe. No one had written anything on h.264 decode at this moment. Only MPEG2 in vdpau code in Gallium3d driver which nouveau support.

If you're running ion install the nvidia binary blob for hardware decoding.