The existing methods for functional regression can be roughly divided into two categories: direct functional regression (DFR) and functional regression based on functional principal component analysis (FR-FPCA). DFR may contain too much noise, while FR-FPCA may be inefficient because FPCA is independent of the response. In this paper, we investigate the effect of a vector of random curves on a response by extracting the latent features of the random curves that are associated with the response. Furthermore, to improve flexibility and predictive accuracy, we propose a generalized additive multiple index model that captures the relationship between the latent features and the response, without specifying component and link functions. We form an objective function based on a penalized quasi-likelihood function and FPCA to extract features, and to estimate the parameters and functions. We further develop an iterative algorithm, which is proven to be convergent and can expediently implement the proposed procedures. The convergence rates, oracle property, selection consistency and asymptotic normality