Integral equation analysis of electromagnetic wave propagation in periodic structure and error analysis of various basis functions in projection of plane waves