Risk Consideration and Cost Estimation in Construction Projects Using Monte Carlo Simulation claudius a. peleskei Universitatea Tehnica din Cluj-Napoca, Romania claudius.peleskei@gmail.com vasile dorca Universitatea Tehnica din Cluj-Napoca, Romania vasile.dorca@betfair. com radu a. munteanu Universitatea Tehnica din Cluj-Napoca, Romania radu.a.munteanu@ethm.utcluj.ro radu munteanu Universitatea Tehnica din Cluj-Napoca, Romania radu.munteanu@ethm.utcluj.ro Construction projects usually involve high investments. It is, therefore, a risky adventure for companies as actual costs of construction projects nearly always exceed the planed scenario. This is due to the various risks and the large uncertainty existing within this industry. Determination and quantification of risks and their impact on project costs within the construction industry is described to be one of the most difficult areas. This paper analyses how the cost of construction projects can be estimated using Monte Carlo Simulation. It investigates if the different cost elements in a construction project follow a specific probability distribution. The research examines the effect of correlation between different project costs on the result of the Monte Carlo Simulation. The paper finds out that Monte Carlo Simulation can be a helpful tool for risk managers and can be used for cost estimation of construction projects. The research has shown that cost distributions are positively skewed and cost elements seem to have some interdependent relationships. Key words: risk management, Monte Carlo Simulation, construction, probability distribution Introduction Many construction projects are undertaken in a complex and continuous changing environment. Systems and approaches are developed management 10 (2): 163-176 Claudius A. Peleskei et al. by theoreticians and used by practitioners to cope with the new challenges. While for some industries these systems have a sufficient number of mathematical models for risk analyses, the construction industry suffers from underdevelopment (Flanagan and Norman 1993). This is partially due to the non-homogeneous and non-serial character and the high dependence of the success of the projects linked to the skills of the individual project manager. Furthermore, the increased national and international competition forces the constructors to focus on their core competence. These effects result in an increasing degree of outsourcing and a reallocation of the risks related to costs, time schedule and quality (Girmscheid and Busch 2014). According to a survey of the Philipp Holzmann ag, 41% of the losses of construction projects is related to miscalculations in the pre-contract phase and 22% to project risks. 30% of the costs incurs during the construction phase and only 7% is related to force majeure. Philipp Holzmann ag could have increased the margin by 3% in avoiding 10% of the poorest contracts (Linden 1999). Smith (1999) finds out that expenditure on the appraisal of major engineering projects represent only 10% of the capital costs of the project. However, during this period 80% of the total project costs are frozen. This shows how important the identification of the major risks and estimation of the costs at the beginning of a construction project are. In 2008, the Boston Globe pointed out that the project 'Boston's Big Dig' ended up costing almost $22 Billion vs. a budget of $2.6 Billion (Murphy 2008). The German Airport Berlin-Brandenburg showed in June 2014 a cost overrun of more than 150% to an amount of 5.4 Billion € (see http://www.flughafen-berlin-kosten.de/). These are only two examples of a huge number of miscalculated projects with cost overruns showing that an adequate cost calculation is more than needed. Such a cost calculation has to consider beside the basic costs also contingencies, which represent the risk of the project. For this, a well-implemented and complete risk management system with mathematical models for the risk analysis is needed. This is not easy, as the practitioners of the construction industry believe that the success of the project is highly dependent on the experience of the project manager gained over many years. They believe that experience cannot be easily transferred to mathematical models (Ashworth 1987). Within risk management process the risk analysis is seen as the most difficult component, but it is also the most useful (Touran, management • volume 10 164 Risk Consideration and Cost Estimation in Construction Projects Yang, and Lowe 2011). This paper is focused on finding out if the Monte Carlo Simulation can be used to improve risk analysis and hence lead to a better estimation of costs in construction projects. Literature Review Every venture bears a risk. Therefore, it is important to understand how a risk is defined and what its sources are. In general, a risk can be defined as any uncertainties that, if it occurs, would affect one or more objectives (Hilson 2004). Hence, risk bears threat and opportunities. Usually six types of risks can be defined for the construction area (Girmscheid and Busch 2014): • legal risks • scheduling risks • technical risks • financial risks • management risks • environmental risks However, a common use and interpretation of the risk types does not exist in the literature. Not all six types of risks may be important for a specific construction project. The dimension of the risks will be defined by factors as project size, environment, skills and experience of the employees, financial factors, technical complexity of the project, etc. Beside the basic costs of a project, which mainly consist of design, production (cost for labour and construction material) and installation, the total costs of a construction project and hence the success of the project is affected by risks. An overview of the published work on the topic risk and the valuation of construction projects were performed by Touran, Yang and Lowe (2011). The considered literature mainly describes risk models based on the estimation on probabilities and their effect. They remark that a sufficient database is not given for the used stochastic models to analyze the cost and time table risks. Detailed remarks of mathematical evidence according to this statement are not given. In a study performed 1992 Touran and Wiser (1992) used information from 1.014 low-rise buildings in the us The costs were broken down to 15 different items. After a Test of Goodness of Fit on each cost item, the lognormal distribution was concluded to fit best. The results were used to perform the Monte Carlo Simulation, once with assuming independence of the data and then with recognizing correlations. number 2 • summer 2015 Claudius A. Peleskei et al. A literature review of Baccarini (2005) came to the result that traditional percentage is the most commonly used estimating method in practice for considering project cost contingencies. However, other methods gained more and more interest, of which one is the Monte Carlo Simulation. Wall (1997) analyzed a number of 216 new built offices from the uk. After the Test of Goodness of Fit was performed, the beta and lognormal distributions were used for the Monte Carlo Simulation. Furthermore, the author concluded that correlations between the cost items have to be taken into account. Ignoring the correlation is more intense than the choice of the distribution, lognormal or beta. Previous studies agree that by considering correlation in simulating and analyzing the risk results in a better estimation of variance of the distribution of total costs of construction projects (Chou 2011; Yang 2005; Flanagan and Norman 1993). Hollauf (n.d.) reviewed construction projects in the uk. Data for a sample size of 58 construction objects were analyzed. The author found out that a dependency between the different cost elements exists and the correlation between these needs to be taken into account when performing Monte Carlo Simulation. The German authors Girmscheid and Busch (2007) recommend the Monte Carlo Simulation among others for quantifying risk. In using the Monte Carlo Simulation, the authors agree that experts have to define for each risk a minimum, maximum and most reliable outcome and the corresponding probability. The resulting risk has to be considered as contingency in the general costs of the project. Some authors define the venture during the construction period as uncertainties and not as risk. This is because the venture is based on subjective estimation and not on statistical investigation. The use of probabilities based on subjective assumptions lead to misinterpretations. Loizou and French (2012) make some critical notices to the use of the Monte Carlo Simulation in the construction industry as for every event subjective probabilities have to be designed. Statistical data from the past is often not available or statistical not significant. Summarizing the literature, it can be said that for construction projects the analysis of risk and its potential impact is proposed. However, the conditions to determine the input parameters are rarely discussed. The critic of the literature focuses on subjective assumptions for probabilities, which can lead to misinterpretations. An analysis of historical data and their use in the context does exist only rudimental. 164 management • volume 10 Risk Consideration and Cost Estimation in Construction Projects Methodology During the proposal stage, a feasibility study is usually initiated without knowing the exact design and demands of the client. Due to the high risk within this business and to prevent cost overruns, it is common to add a reserve amount to the project costs, the so-called contingency. The calculation methods for such contingencies can be divided into three main categories: deterministic methods, probabilistic methods and modern mathematical methods (Bakhshi and Touran 2014). Current practice considers risks of the project such as changes in design and project by applying a contingency allowance based on deterministic methods or single point estimation. These methods are easy to handle without demanding a high knowledge of statistics, but as the conditions are not stable, the utility of this approach is reduced. It is highly recommended to use a range estimation rather than single point estimation. This way the variation in the outcomes is reflected (Elkjaer 2000). The two methods that can be used to analyze risk in the estimation of project-outrun costs are sensitivity analysis and probabilistic risk analysis (Tan and Makwasha 2010). These approaches require a big range of data. However, historical data are limited especially in the construction industry. The problem could be solved by using simulations like Monte Carlo Simulation. Simulation based cost analysis requires two sets of data inputs which are, the marginal distribution of the individual cost elements and the correlation matrix consisting of the correlation coefficients between the different pairs of cost elements. Both sets of inputs can be estimated in two ways, (1) using historical data from past projects, (2) subjective judgment or using experience and intuition (Yang 2005). This research tries to find out how Monte Carlo Simulation can be useful to estimate the costs and determine the contingency for the project, based on historical data. The approach follows the next five steps: • Collection of historical data • Definition of the Total Construction Costs (tcc) • Test of Goodness of Fit • Determination of correlation • Monte Carlo Simulation The used historical data are in accordance with the cost breakdown structure as applied by the bki (Baukosteninformationszen- number 2 • summer 2015 Claudius A. Peleskei et al. trum Deutscher Architektenkammern). The data used in this research was obtained from the Kostenplaner 17 cd. The cost structure follows the din 276-1:2008-12. The costs of a building are class-divided into costs for the land, on-site infrastructure works, building construction, external areas, equipment and artwork and incidental costs. This research focuses on the building costs consisting of costs for the building pit, foundation, exterior walls, interior walls, ceiling, roof, fittings and other measures for construction. Cost data of totally 75 administrative buildings in Germany are analyzed. The buildings were finished between 1976 and 2013. The gross floor area of the buildings is between 269 and 25.134 square meter. 24% of the buildings have a gross floor area of less than 1.000 m2 and 33% higher than 5.000 m2While 84% of the buildings is from the private sector, the rest is from public sector. The sample was assumed large enough to minimize the sampling error that could occur in such studies and is considered a good representation of the population. The sample group, was chosen as it had more data available than other groups. By presenting the data in cost per square meter, the problem of project size or scale is eliminated. The tcc are defined to be the sum of the elemental costs per square meter. The gross floor space of the buildings is used as the common factor for the different cost elements. This step is followed by the definition of the probability distributions for the cost elements. This will be done by performing the Anderson-Darling Test. The determination of the correlation between the cost elements is very important. If correlations are ignored, this might result in a significant underestimation of the costs for the job. For the correlation matrix, the Spearman rank correlation coefficients will be calculated. The correlation matrix will then be tested for its feasibility as appropriate (Yang 2005). Using the results, Monte Carlo Simulation will be performed with the help of the Software Crystal Ball®. Each simulation generates a random set of possible values for each of the cost elements according to the specified marginal distributions. Two sets of 100 000 runs will be performed; one incorporating correlated data and the other assuming independence of elemental cost data. Monte Carlo Simulation This paper researches in which way historical data of construction projects follow a certain distribution and if these data can be used to model the possible future costs of a project. 164 management • volume 10 Risk Consideration and Cost Estimation in Construction Projects table 1 Descriptive Statistics for Elemental Cost Data Item (1) (2) (3) (4) (5) (6) (7) (8) Mean 29.68 259.14 472.00 258.94 296.60 330.99 26.20 45.76 Median 20.15 256.10 467.57 227.91 281.76 292.48 14.86 39.03 Variance 842.78 10214.52 27433.61 20277.98 7786.95 14984.88 1009.33 811.85 Std. var. 29.03 101.07 165.63 142.40 88.24 122.41 31.77 28.49 Min 5.59 11.02 170.42 100.52 157.11 148.29 0.17 10.28 Max 148.73 686.67 1.040.81 1.249.99 616.62 674.71 145.38 156.30 Range 143.14 675.65 870.39 1.149.47 459.51 526.42 145.21 146.02 1st quart. 13.08 194.75 326.17 185.15 239.38 247.41 3.38 25.33 3rd quart. 29.72 319.13 598.71 300.61 353.39 406.48 32.02 60.71 Skew 2.44 1.15 0.60 4.78 1.10 0.84 1.99 1.41 Kurtosis 6.26 3.84 0.53 31.66 2.38 0.11 4.01 2.60 Mean std. err. 3.47 11.67 19.13 16.44 10.40 14.14 4.28 3.29 notes Column headings are as follows: (1) building pit, (2) foundation, (3) exterior walls, (4) interior walls, (5) ceiling, (6) roof, (7) fittings, (8) others. test of goodness of fit The fitting of the distribution to each cost element was done by using the Software Crystal Ball®. The Anderson-Darling test was used to decide on the best fit for each element. The Anderson-Darling Test measures the distance between the hypothesized distribution F and the empirical cumulative distribution function Fn (Anderson and Darling 1952). roo (Fn(X)-F(X)V A-J-ooF(X)(i-F(X))aif(Xh (1) Table 1 gives an overview of the statistics of the data. For all cost components, the best fitting distribution is the lognormal. It can be noted that the marginal distributions of the cost elements are all positive skewed and all the cost components have a mean, which is greater than the median. This is consistent with past researches (Wall 1997). The exterior walls have the highest costs per square meter with the highest variance. The positive skewness of the distributions does not really surprise, as construction projects rather tend to have costs overruns then lower costs as foreseen. The tails of the distribution of the cost elements are longer to the right side, which suggests that a major part of the costs fall below the average, but a few extreme cases exceed the average. These extreme cases are subject to risk management and need to be taken into consideration. They can lead to project overruns. The tail probabilities have to be studied to set up the contingency for a project. number 2 • summer 2015 Claudius A. Peleskei et al. table 2 Anderson-Darling Goodness of Fit Test Item (1) (2) (3) (4) (5) (6) (7) (8) Distribution l l w l l l l l a-d 0.46 0.35 0.46 0.41 0.32 0.28 0.57 0.19 notes Column headings are as follows: (1) building pit, (2) foundation, (3) exterior walls, (4) interior walls, (5) ceiling, (6) roof, (7) fittings, (8) others. l - lognormal, w -weibull, a = 95%. Half of the distributions have a kurtosis value higher than three. This indicates them being more peaked or having taller peaks compared to the normal distribution. This indicates the portion of extreme deviations from the mean value being high. This is mainly for the interior walls, while exterior walls are highly platykurtic with a value of 0.53. It is crucial to specify the probability distribution of the cost elements. The quality of the results for the better-fit test increases with the available number of data. Previous studies assume the beta, uniform, triangular and lognormal distributions to fit best to the cost data. For historical data, researches suggest the lognormal distribution to fit the best (Touran and Wiser 1992; Wall 1997) This research is in line with past results and finds out that for almost all the given data the lognormal distribution is the best fitting. Table 2 gives an overview of the results. For the exterior walls, the Weibull distribution fits the best. Nevertheless, the lognormal distribution for the exterior walls has also a good a-d value with 0.5789. correlations of the cost elements When running a simulation-based cost analysis correlations must be considered if they are significant (Yang 2005). Ignoring correlations might result in a significant underestimation of the costs for the job, and this becomes even more significant if we consider a portfolio of different jobs (Bakhshi and Touran 2012). The rank (Spearman) correlation coefficient was used to reflect the degree of relation between the different cost elements. The advantage of the Spearman correlation coefficient is its use in case of a non-linear relationship between the variables and if both populations are not normally distributed (Yang 2005). The Spearman correlation coefficient is defined by following equation: 6! I1 d2 n(n2 -1) ' 164 management • volume 10 Risk Consideration and Cost Estimation in Construction Projects table 3 Spearman Rank Correlation Coefficient Item (1) (2) (3) (4) (5) (6) (7) (8) (1) 1.0000 0.2108 0.1422 0.0898 0.1742 0.2081 0.1371 0.1258 (2) 1.0000 0.2773 0.2462 0.2858 0.2484 0.0149 0.3382 (3) 1.0000 0.5709 0.4924 0.5621 0.1746 0.4293 (4) 1.0000 0.4538 0.5175 0.2952 0.3217 (5) 1.0000 0.5775 0.4238 0.2991 (6) 1.0000 0.1489 0.3654 (7) 1.0000 -0.0604 (8) 1.0000 notes Column headings are as follows: (1) building pit, (2) foundation, (3) exterior walls, (4) interior walls, (5) ceiling, (6) roof, (7) fittings, (8) others. where d is the difference between the ranks of the corresponding x and y. The coefficients can range between -1 and +1. A coefficient of +1 shows a perfect positive and -1 a perfect negative relationship. Analysis of the data shows a positive correlation between the different cost elements. This is also in line with past research (Wall 1997). To find out the significance of the correlation, a null hypothesis was tested against an alternative hypothesis. To test the spearman rank order correlation coefficients for significance at a level of 5%, the Z score test was performed. • Null hypothesis: Cj = 0 • Research hypothesis: Cj = 0 zij = Cijy/N^i, (3) where C is the correlation between the different cost elements and N is the sample size. The statistics transform the correlation coefficients to z scores on the standard normal probability distribution. The test statistic z is normally distributed for N > 30 and therefore can be compared to the critical values z of the standard normal distribution. To test if the correlation coefficient is significantly different from zero the above test statistics are compared to the 1.96 critical value of z at the 5% level of significance. Table 4 reflects the outcome. The Z score test shows a significant correlation between some of the cost elements. This is consistent with past research (Yang 2005). The correlation is significant mainly between the costs for the main structures of a house: ceiling, walls and the roof. For 17out of 28 of the coefficients, the critical value of 1.96 is exceeded. The use of a number 2 • summer 2015 Claudius A. Peleskei et al. table 4 Z Score for the Correlations of the Cost Elements Item (1) (2) (3) (4) (5) (6) (7) (8) (1) 1.0000 1.7514 1.1808 0.7463 1.4470 1.7288 1.1385 1.0450 (2) 1.0000 2.3852 2.1177 2.4586 2.1369 0.1279 2.9094 (3) 1.0000 4.9113 4.2359 4.8355 1.5024 3.6929 (4) 1.0000 3.9039 4.4520 2.5395 2.7676 (5) 1.0000 4.8659 3.5707 2.5200 (6) 1.0000 1.2805 3.1429 (7) 1.0000 -0.4438 (8) 1.0000 notes Column headings are as follows: (1) building pit, (2) foundation, (3) exterior walls, (4) interior walls, (5) ceiling, (6) roof, (7) fittings, (8) others. correlation matrix in the Monte Carlo Simulation has to be feasible. This restricts the matrix to be positively semi definite, which means that the eigenvalue of the matrix must be non-negative (Yang 2005). A further discussion is not required as in the given situation the used correlations are all positive. simulation of the total costs of construction For modelling, the distribution of the tcc the Monte Carlo Simulation was applied by using Crystal Ball®. Monte Carlo Simulation generates samples {X(r)}R=1 from a given probability distribution P(x). For each cost element, the best fitting probability distribution for its historical data was used. The details of the distribution are described in the above tables one and two. If we talk about simulation, we talk about generating a sample of random numbers. These numbers can be out of a range between 0 and 1. Monte Carlo is used to solve a mathematical or statistical problem. For example, when we throw darts on a figure and determine the relation of the hits to the missed darts. A Monte Carlo Simulation uses the random sampling of an experiment to determine the properties of some phenomenon (Sawilowsky 2003). It was found out that the distributions of the tcc are positively screwed and show a heavy tail to the right. This is not surprising and again in line with past research results (Yang 2005). Furthermore, it was shown that the distribution without correlation of the cost elements has a lower range of possible outcomes. This means that the tcc without correlation underestimates the cost risk of a project. It points out that correlation needs to be accounted for when costs are estimated. The potential of running low costs, but also running losses is bigger because correlated construction factors add up each 164 management • volume 10 Risk Consideration and Cost Estimation in Construction Projects table 5 Statistics for the Two tcc Distributions Statistics tcc without correlation tcc with correlation Trials Mean Median Mode Standard deviation Variance Skewness Kurtosis Coefficient of variability Minimum Maximum Range width Mean standard error 31.891.93 456.70 5.154.76 4.698.06 100000 962.61 946.42 178.58 1.51 17.17 0.19 0.56 280.07 78.441.83 1.45 13.46 0.29 322.96 7.789.76 7.466.80 100000 962.67 927.71 0.89 other. Further, it has to be mentioned that the distribution of the tcc without correlation has a greater peak, while both distributions are highly leptokurtic. The results of the Monte Carlo Simulation can be used to get a better understanding of the range of the costs. Constructors can make visible which effect risks could have on the costs of a project and how the effect can increase or decrease because of correlation between the cost elements. Furthermore it is possible to define which the minimum costs of the project are if a certain probability is demanded. For example the project costs will not exceed 1.400 €/m2 with a probability of 90%. The results are shown in table 3. Conclusion The research investigated how Monte Carlo Simulation can be used for cost estimation in construction projects. While the major part of past studies conclude that the estimation of the distribution for the cost elements has to be done subjective by experts, this paper analyses if historical data can be used for Monte Carlo Simulation. Furthermore, it analyses if a significant correlation between the input factors of the Monte Carlo Simulation exists. It was found out that historical data could be used for a Monte Carlo Simulation to give project manager an idea of the variation in costs. It can be implemented into the risk management process to take better decision on the best mitigation strategy. The average cost of the selected office buildings used is about g62€/m2 per square meter, while ignoring quality, technology, location and other factors. number 2 • summer 2015 Claudius A. Peleskei et al. It was shown that the average value could be exceeded by a very large amount. More than half of the correlations between the cost elements were significant at a coefficient level of 95%. The resulting two probability distributions show that the consideration of the interdependency is important in the risk analysis and must be incorporated in the estimation of the total costs. Ignorance of the correlation might lead to an underestimation of the variance of the project costs. This can lead to inadequate contingencies set up. It was shown that the lognormal has the best fit compared to other distributions on most of the cost elements. The tcc distribution is likely to be lognormal itself due to self-replication property of the lognormal distribution. The tcc distribution is heavily reliant on the marginal distributions of the cost elements, which are dependent on the data, used. The research did not consider the price variance of the buildings resulting from the type of the buildings, quality or location. This might have contributed to the large variation and outliers in the data. A further refinement might result in a higher accuracy of the estimation but this will result in less historical data. As mentioned at the beginning of this paper, in particular for the construction industry the selection of the projects is high sensitive. Companies within this business are characterized by a small number of high volume projects. The projects have a realization time of some months or even years. These facts imply a high volume of investments for a longer period. The investments are related not only to the construction materials, but also to production facilities, etc. As a result, the economic success and future of a company is high dependent on the success of singular projects. How important the right choice of projects are, shows the example of the Philipp Holzmann ag. Philipp Holzmann ag could have increased the margin by 3% in avoiding 10% of the poorest contracts (Linden 1999). Companies need to include their experience gained from past projects accurate into their project calculation for new tenders. This way it is easier to offer a price to the client that covers the costs/risks and ensures the company's future. Finding the right tender price is decisive in competitiveness. A low price would not necessarily cover all risks and a high price would result in losing a tender to a better-prepared competitor. The current practice considers the risks of the project mainly by using single point estimation. These methods are easy to handle but the utility is limited (Elkjaer 2000). The use of the Monte Carlo Simulation by using past data as shown in this paper 164 management • volume 10 Risk Consideration and Cost Estimation in Construction Projects reflects the variation in the outcomes. Project manager get a visible range of the possible outcomes of the projects, which ensures a better decision. References Anderson, T. W., and D. A. Darling. 1952. 'Asymptotic Theory of Certain "Goodness of Fit" Criteria Based on Stochastic Process.' The Annals of Mathematical Statistics 23:193-212. Ashworth, A. 1987. 'The Computer and the Estimator.' Technical Information Service Paper 81, Chartered Institute of Building, Bracknell. Baccarini, D. 2005. 'Understanding Project Cost Contingency: A Survey.' Paper presented at the cobra International Construction Conference, Brisbane, 4-8 July. Bakhshi, P., and A. Touran. 2012. 'A Method for Calculating Cost Correlation among Construction Projects in a Portfolio.' International Journal of Architecture, Engineering and Construction 1 (3): 134-41. -. 2014. 'An Overview of Budget Contingency Calculation Methods in Construction Industry.' Procedia Engineering 85:52-60. Chou, J.-S. 2011. 'Cost Simulation in an Item-Based Project Involving Construction Engineering and Management.' International Journal of Project Management 29 (6): 709-17. Elkjaer, M. 2000. 'Stochstic Budget Simulation.' International Journal of Project Management 18 (2): 139-47. Flanagan, R., and G. Norman. 1993. Risk Management and Construction. Oxford: Blackwell. Girmscheid, G., and T. A. Busch. 2007. 'Risikomanagement-ProzessModell für Baunternehmen - Risikobelastungsdimension.' Bauingenieur 82 (2): 53-61. -. 2014. Projektrisikomanagement in der Bauwirtschaft. 2nd ed. Berlin: Beuth. Hilson, D. 2004. Effective Opportunity Management for Projects. New York and Basel: Dekker. Hollauf, T. N.d. 'A simulation Based Approach to Cost Estimation of Construction Costs Using the Monte Carlo Simulation Technique.' http:// www.academia.edu/2405754/A_simulation_based_approach_to _cost_estimation_of_construction_costs_using_the_Monte_Carlo _simulation_technique Linden, M. 1999. 'Risikomanagement gegen den Baustellenteufel.' Bauwirtschaft 53 (9): 9. Loizou, P., and N. French. 2012. 'Risk and Uncertainty in Development: A Critical Evaluation of Using Monte Carlo Simulation Method as a Decision Tool in Real Estate Development Projects.' Journal ofProp-erty Investments and Finance 30 (2): 198-210. number 2 • summer 2015 Claudius A. Peleskei et al. Murphy, S. P. 2008. 'Big Dig's Red Ink Engulfs State.' The Boston Globe, 17 July. Sawilowsky, S. S. 2003. 'You Think You've Got Trivials?' Journal of Modern Applied Statistical Methods 2 (1): 218-25. Smith, N. J. 1999. Managing Risk in Construction Projects. Oxford: Blackwell. Tan, F., and T. Makwasha. 2010. 'Best Practice' Cost Estimation in Land Transport Infrastructure Projects.' Paper presented at the 33rd Australasian Transport Research Forum, Canberra, 29 September-1 October. Touran, A., J. B. Yang, and D. Lowe. 2011. 'Construction Risk Modelling and Assessment: Insights from a Literature Review.' The Built and Human Environment Review 4 (1): 87-97. Touran, A., and E. Wiser. 1992. 'Monte Carlo Technique With Correlated Random Variables.' Journal of Construction Engineering and Management 118 (2): 258-72. Wall, D. M. 1997. 'Distribution and Correlations in Mote-Carlo Simulation.' Construction Management and Economics 15:241-58. Yang, I. T. 2005. 'Simulation-Based Estimation for Correlated Cost Elements.' International Journal of Project Management 23:275-82. This paper is published under the terms of the Attribution-NonCommercial-NoDerivatives 4.0 International (cc by-nc-nd 4.0) License (http://creativecommons.org/licenses/by-nc-nd/4.o/). 164 management • volume 10