Abstract
This chapter motivates, develops, and explains a market-clearing algorithm for the day-ahead market, intended for electric energy markets with a significant number of stochastic producers. To adequately mimic the real-world decision-making process, a two-stage stochastic programming model with recourse is presented. Market outcomes include both production and consumption quantities, and energy-only clearing prices. These prices embody desirable properties such as revenue adequacy in expectation and cost recovery, also in expectation. Complementarily, and as alternative to the two-stage stochastic programming approach, this chapter also introduces a dispatch method for energy and reserve that copes with uncertain generation using adaptive robust optimization. A number of clarifying examples illustrate the theoretical interest and practical relevance of the proposed market-clearing algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bertsimas, D., Brown, D.B., Caramanis, C.: Theory and applications of robust optimization. SIAM Rev. 53(3), 464–501 (2011)
Bertsimas, D., Litvinov, E., Sun, X.A., Zhao, J., Zheng, T.: Adaptive robust optimization for the security constrainted unit commitment problem. IEEE Trans. Power Syst. 28(1), 52–63 (2012)
Billinton, R., Allan, R.N.: Reliability Evaluation of Power Systems. Plenum Press, New York (1984)
Birge, J.R., Louveaux, F.: Introduction to Stochastic Programming, 2nd edn. Series in Operations Research and Financial Engineering. Springer, New York (2011)
Bouffard, F., Galiana, F.D., Conejo, A.J.: Market-clearing with stochastic security–Part I: Formulation. IEEE Trans. Power Syst. 20(4), 1818–1826 (2005)
Chao, H., Huntington, H.: Designing Competitive Electricity Markets. International Series in Operations Research & Management Science. Kluwer, Boston (1998)
Conejo, A.J., Carrión, M., Morales, J.: Decision Making Under Uncertainty in Electricity Markets. International Series in Operations Research & Management Science. Springer, New York (2010)
Conejo, A.J., Castillo, E., Mínguez, R., García-Bertrand, R.: Decomposition Techniques in Mathematical Programming: Engineering and Science Applications, chap. 5, pp. 197–199. Springer, Berlin (2006)
Galiana, F.D., Bouffard, F.: An electricity market with a probabilistic spinning reserve criterion. IEEE Trans. Power Syst. 19(1), 300–307 (2004)
Gómez-Expósito, A., Conejo, A.J., Ca˜nizares, C.: Electric Energy Systems: Analysis and Operation. CRC Press, Boca Raton (2009)
Jiang, R., Wang, J., Guan, Y.: Robust unit commitment with wind power and pumped storage hydro. IEEE Trans. Power Syst. 27(2), 800–810 (2012)
Morales, J.M., Conejo, A.J., Liu, K., Zhong, J.: Pricing electricity in pools with wind producers. IEEE Trans. Power Syst. 27(3), 1366–1376 (2012)
O’Neill, R.P., Sotkiewicz, P.M., Hobbs, B.F., Rothkopf, M.H., Stewart, W.R.: Efficient market-clearing prices in markets with non-convexities. Eur. J. Oper. Res. 164(1), 269–285 (2005)
Pritchard, G., Zakeri, G., Philpott, A.: A single-settlement, energy-only electric power market for unpredictable and intermittent participants. Oper. Res. 58(4), 1210–1219 (2010)
Ruiz, C., Conejo, A.J., Gabriel, S.A.: Pricing non-convexities in an electricity pool. IEEE Trans. Power Syst. 27(3), 1334–1342 (2012)
Stoft, S.: Power System Economics: Designing Markets for Electricity. Wiley–IEEE Press, New York (2002)
Wong, S., Fuller, J.D.: Pricing energy and reserves using stochastic optimization in an alternative electricity market. IEEE Trans. Power Syst. 22(2), 631–638 (2007)
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Settlement Scheme Properties
The properties of the settlement scheme in Sect. 3.3.1 are formally stated below in the form of theorems. For this purpose, we define first the following indices:
- s(i) :
-
Index of the bus where conventional unit i is located.
- s(j) :
-
Index of the bus where load j is located.
- s(q) :
-
Index of the bus where stochastic production unit q is located.
Theorem 3.1 (Revenue adequacy in expectation).
Consider the market-clearing procedure (3.12), built on a stochastic programming framework, and the resulting sets of dual variables \(\left\{{\lambda^{\rm D}}_{\!\!\!n}, \forall n \in N \right\}\) and \(\left\{\left({\lambda^{\rm B}}_{\!\!\!\!n \omega}, {\pi}_{\omega}\right)\right.\), \(\left.\forall n \in N, \forall \omega \in \Omega\right\}\). The settlement scheme (3.13) is revenue adequate in expectation.
Proof
Mathematically, the settlement scheme (3.13) is revenue adequate in expectation if, at the optimum, it holds
where \(\left\{{\lambda^{\rm B*}_{n\omega}} = \gamma_{n\omega}^{*}\big/{\pi}_{\omega}, \forall n \in N, \forall \omega \in \Omega\right\}\) are the probability-removed balancing prices and superscript “ \(*\) ” denotes optimal values.
Using the power balance equations (3.12b) and (3.12c), expression (3.22) can be equivalently rewritten as follows:
Let us consider the following partial Lagrangian function of problem (3.12):
Since problem (3.12) is linear and thus convex, \({\mathcal{L}}\) is minimized subject to the rest of constraints, i.e., constraints (3.12d) –(3.12s), at the optimum. Note that by moving the power balance equations (3.12b) and (3.12c) to the objective function (3.12a) to form the partial Lagrangian function \({\mathcal{L}}\), the resulting optimization problem {minimize (3.24), subject to (3.12d) –(3.12s) } can be decomposed into appropriate minimization subproblems for any given set of Lagrange multipliers \(\{{\lambda^{\rm D}_{n}}, \forall n \in N; \gamma_{n\omega}, \forall n \in N, \forall \omega \in \Omega\}\). In particular, the summation of the following terms, extracted from (3.24),
is minimized subject to constraints (3.12d) –(3.12i) at the optimum.
A solution such that \({\delta}_{n}^{0} = 0, \forall n \in \Omega\) ; \({\delta}_{n\omega} = 0, \forall n \in N, \forall \omega \in \Omega\), is feasible for the minimization subproblem {minimize (3.25), subject to (3.12d) –(3.12i) }, as long as the capacity of transmission lines is non-negative, i.e., \(C_{\ell}^{\rm max} \geq 0\), \(\forall \ell \in \Lambda\). This solution allows us to set the upper bound of expression (3.25) to zero. Therefore, inequality (3.23) holds, and this concludes the proof.
Theorem 3.2 (Cost recovery in expectation).
Consider the market-clearing procedure (3.12), built on a stochastic programming framework, and the resulting sets of dual variables \(\left\{{\lambda^{\rm D}_{n}}, \forall n \in N \right\}\) and \(\left\{\left({\lambda^{\rm B}_{n\omega}}, {\pi}_{\omega}\right)\right.\), \(\left.\forall n \in N\right.\), \(\left.\forall \omega \in \Omega\right\}\). The settlement scheme (3.13) guarantees cost recovery for all market participants in expectation.
Proof
The settlement scheme (3.13) ensures that both conventional and stochastic producers recover their energy production costs in expectation. Mathematically, this is expressed as follows:
and
where superscript “ \(*\) ” denotes optimal values and \({\lambda^{\rm B*}_{n\omega}} = \frac{\gamma^{*}_{n\omega}}{{\pi}_{\omega}}, \forall n \in N, \forall \omega \in \Omega\).
Let us consider again the partial Lagrangian function (3.24). At the optimum, this function is minimized subject to constraints (3.12d) –(3.12s). As stated in the proof for revenue adequacy in expectation, the optimization problem {minimize (3.24), subject to (3.12d) –(3.12s) can be decomposed into appropriate minimization subproblems for any given set of shadow prices \(\{{\lambda^{\rm D}_{n}}, \forall n \in N; \gamma_{n\omega}, \forall n \in N, \forall \omega \in \Omega\}\). Specifically, the series of terms extracted from (3.24)
and
are minimized, for all \(i \in I\) and for all \(q \in Q\), subject to the set of constraints {(3.12k) –(3.12p),(3.12s) } and {(3.71j), (3.12r), (3.12s) }, respectively.
The collection of decision variables such that \(P_{i} = {R^{\rm U}_i} = {R^{\rm D}_i} = 0, \forall i \in I\) (here, we appeal to assumption A7, according to which conventional producers are fully dispatchable) and \({r^{\rm U}}_{\!\!\!\!\!i\omega} = {r^{\rm D}}_{\!\!\!\!\!i\omega} = 0\), \(\forall i \in I, \forall \omega \in \Omega\), constitutes a feasible solution to the minimization subproblem made up of the objective function (3.28) and the group of constraints (3.12k) –(3.12p), and (3.12s). Likewise, the set of decision variables such that \({W^{\rm S}_{q}} = 0\), \(\forall q \in Q\), and \({W^{\rm spill}_{q\omega}} = W_{q\omega}\), \(\forall q \in Q\), \(\forall \omega \in \Omega\), is a feasible solution to the minimization subproblem composed of the objective function (3.29) and constraints (3.71j), (3.12r), and(3.12s). This pair of solutions sets the upper bound of expressions (3.28) and (3.29) to zero. Consequently, inequalities (3.26) and (3.27) hold, which concludes the proof.
It is important to underline that the decomposition-based reasoning employed to prove Theorem 3.2 cannot be used, however, to prove cost recovery per scenario due to the day-ahead dispatch variables P i and \({W^{\rm S}}_{\!\!\!q}\), which link all the scenarios together. This is so because the settlement scheme (3.13) allows power producers to incur economic losses in some scenarios as long as they recover their production costs in expectation, i.e., in the long run and under similar conditions.
Appendix 2: Worst-Case Realization of Uncertain Production in Robust Optimization
In this appendix, we prove that the worst-case uncertainty realization for the adaptive robust optimization problem (3.21) occurs at an extreme point of the polyhedral uncertainty set \(\mathcal W\) for the deviation of wind power production from its conditional mean forecast.
Let us consider the inner max-min problem in (3.21):
Notice that we indicated the dual variables for the inner minimization problem on the right-hand side of the corresponding constraints, preceded by a colon.
First of all, we can reformulate inequalities (3.30k) and (3.30l) as follows:
It is worth to point out that reformulation (3.31) is linear, on the contrary of (3.30k)–(3.30l).
Denoting the set of dual variables of the inner problem (3.30a) –(3.30j) with \(\Xi'\), we can replace the inner minimization problem with its dual (see Appendix B of the book). This renders the following problem:
The following observations on model (3.32) are in order.
-
1.
The two max operators can be merged. Therefore, (3.32) is a single maximization problem.
- 2.
-
3.
Objective function (3.32a) is bilinear, owing to the cross products between variables \(\Delta W_q\) and λ n as well as \(\epsilon^{\rm spill}_q\).
In view of the observations above, if we fix the variables in \(\Xi'\) at their optimal value, model (3.32) boils down to a linear programming problem in the decision variables \(\Delta W_q\), constrained by (3.32j)–(3.32m). For any linear program, at least one of the solutions (if it exists) is a vertex of the feasible set. Since the feasible set \(\mathcal W\) is compact, at least an optimal solution of the bilinear program (3.32) is a vertex of \(\mathcal W\).
Exercises
3.1.
Reformulate the auction in Example 3.3 to include two time periods. Enforce ramping limits on the thermal generation units and analyze numerically the impact of such limits on market outcomes. Hint: the reader is advised to consult Sect. 5.3.3.
3.2.
Consider multiple Gaussian distributed wind power production scenarios in the problem of Example 3.3. Analyze numerically the impact of increasing the number of scenarios on market outcomes. Compare these outcomes with those obtained considering solely the average value scenario.
3.3.
Consider just two extreme scenarios (very-high wind production and no wind production), and analyze the outcomes of the auction in Example 3.3. Compare these outcomes with the outcomes obtained considering solely the average value scenario. What happens as scenarios become increasingly extreme?
3.4.
Analyze the market-clearing algorithm in Example 3.3 in a case in which only wind producers are available. Study the behavior of prices, both day-ahead prices and balancing prices.
3.5.
Consider the market-clearing algorithm in Example 3.3, but involving thermal plants with significantly high start-up costs. What happens with the clearing prices (both day-ahead and balancing) in such situation? Hint: you can get inspiration on how to model the start-up cost of a thermal power plant from Sect. 8.2.1 in the book.
3.6.
Consider the market-clearing algorithm in Example 3.3, but involving thermal plants with minimum power outputs. What happens with the clearing prices (both day-ahead and balancing) in such situation? Hint: you can get inspiration from Sect. 5.3.2 for the modeling of capacity limits.
3.7.
Consider the auction in Example 3.3, and solve it for a wide range of values of lost load. Study how market outcomes change as a result of an increasingly high unserved-energy value.
3.8.
Consider wind production offers at non-zero price in the auction of Example 3.3. Analyze numerically how market outcomes change as wind offering prices increase.
3.9.
Reformulate the auction in Example 3.3 to include two time periods involving highly different load levels, and a pumped storage plant. Is the availability of such pumped storage plant beneficial? Analyze how the impact of the pumped storage plant on market outcomes changes as the efficiency of the pumping-turbine cycle increases. Hint: Sect. 5.5 provides insight into how to model a pumped-storage power plant.
3.10.
Reformulate the auction in Example 3.3 to include two time periods involving highly different load levels, and a pumped storage plant. Consider that the transmission line has such a low capacity that often leads to transmission bottleneck. Analyze the ability of the pumped storage plant to alleviate the detrimental effect of transmission bottlenecks.
3.11.
Solve the robust optimization problem (3.20) considered in Example 3.6 for different values of the budget of uncertainty in (3.17). Start by enumerating the vertices of the polyhedral uncertainty set. What is the effect of increasing the uncertainty budget on the amount of dispatched reserve?
3.12.
Include constraints of the following type
in the definition of the uncertainty set for the dispatch model based on robust optimization presented in Example 3.6. Determine the uncertainty set and enumerate its vertices, then solve the dispatch problem.
3.13.
Reformulate the robust optimization model (3.20) to include two time periods and a pumped storage plant. Consider the two-node system of Example 3.3, which includes only one wind power plant. Introduce intervals for the deviation of wind power production during each time period, and a budget of uncertainty to limit the total deviation of energy production over the two periods, similarly to (3.16) and (3.17). Analyze the effect on the robust dispatch of a storage facility with limited capacity.
Rights and permissions
Copyright information
© 2014 Springer Science+Business Media New York
About this chapter
Cite this chapter
Morales, J., Conejo, A., Madsen, H., Pinson, P., Zugno, M. (2014). Clearing the Day-Ahead Market with a High Penetration of Stochastic Production. In: Integrating Renewables in Electricity Markets. International Series in Operations Research & Management Science, vol 205. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-9411-9_3
Download citation
DOI: https://doi.org/10.1007/978-1-4614-9411-9_3
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4614-9410-2
Online ISBN: 978-1-4614-9411-9
eBook Packages: Business and EconomicsBusiness and Management (R0)