The situation of a limited availability of historical data is frequently encountered in portfolio risk estimation, especially in credit risk estimation. This makes it, for example, difficult to find temporal structures with statistical significance in the data on the single asset level. By contrast, there is often a broader availability of cross-sectional data, i.e., a large number of assets in the portfolio. This paper proposes a stochastic dynamic model which takes this situation into account. The modelling framework is based on multivariate elliptical processes which model portfolio risk via sub-portfolio specific volatility indices called portfolio risk drivers. The dynamics of the risk drivers are modelled by multiplicative error models (MEM) - as introduced by Engle (2002) - or by traditional ARMA models. The model is calibrated to Moody's KMV Credit Monitor asset returns (also known as firm-value returns) given on a monthly basis for 756 listed European companies at 115 time points from 1996 to 2005. This database is used by financial institutions to assess the credit quality of firms. The proposed risk drivers capture the volatility structure of asset returns in different industry sectors. A characteristic temporal structure of the risk drivers, cyclical as well as a seasonal, is found across all industry sectors. In addition, each risk driver exhibits idiosyncratic developments. We also identify correlations between the risk drivers and selected macroeconomic variables. These findings may improve the estimation of risk measures such as the (portfolio) Value at Risk. The proposed methods are general and can be applied to any series of multivariate asset or equity returns in finance and insurance.