Skip to main content

Distributed Line Search for Multiagent Convex Optimization

  • Conference paper
  • First Online:
Mathematical Control Theory I

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 461))

  • 2342 Accesses

Abstract

This note considers multiagent systems seeking to optimize a convex aggregate function. We assume that the gradient of this function is distributed, meaning that each agent can compute its corresponding partial derivative with information about its neighbors and itself only. In such scenarios, the discrete-time implementation of the gradient descent method poses the basic challenge of determining appropriate agent stepsizes that guarantee the monotonic evolution of the objective function. We provide a distributed algorithmic solution to this problem based on the aggregation of agent stepsizes via adaptive convex combinations. Simulations illustrate our results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. D.P. Bertsekas, J.N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods (Athena Scientific, Belmont, 1997)

    Google Scholar 

  2. F. Bullo, J. Cortés, S. Martínez, Distributed Control of Robotic Networks, Applied Mathematics Series (Princeton University Press, Princeton, 2009). http://coordinationbook.info

  3. A. Cauchy, Méthode générale pour la résolution des systems d’equations simultanées. Comptes rendus de l’Académie des Sciences 25, 46–89 (1847)

    Google Scholar 

  4. J. Cortés, S. Martínez, Distributed line search via dynamic convex combinations, in IEEE Conference on Decision and Control (Florence, Italy, 2013), pp. 2346–2351

    Google Scholar 

  5. B. Gharesifard, J. Cortés, Distributed continuous-time convex optimization on weight-balanced digraphs. IEEE Trans. Autom. Control 59(3), 781–786 (2014)

    Article  Google Scholar 

  6. B. Johansson, M. Rabi, M. Johansson, A randomized incremental subgradient method for distributed optimization in networked systems. SIAM J. Control Optim. 20(3), 1157–1170 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  7. S.S. Kia, J. Cortés, S. Martínez, Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication. Automatica 55, 254–264 (2015)

    Article  Google Scholar 

  8. D.G. Luenberger, Linear and Nonlinear Programming, 2nd edn. (Addison-Wesley, Reading, 1984)

    Google Scholar 

  9. D. Mateos-Núñez, J. Cortés, Noise-to-state exponentially stable distributed convex optimization on weight-balanced digraphs. SIAM J. Control Optim. Submitted (2014)

    Google Scholar 

  10. M. Mesbahi, M. Egerstedt, Graph Theoretic Methods in Multiagent Networks, Applied Mathematics Series (Princeton University Press, Princeton, 2010)

    MATH  Google Scholar 

  11. A. Nedic, A. Ozdaglar, Distributed subgradient methods for multi-agent optimization. IEEE Trans. Autom. Control 54(1), 48–61 (2009)

    Article  MathSciNet  Google Scholar 

  12. A. Nedic, A. Ozdaglar, P.A. Parrilo, Constrained consensus and optimization in multi-agent networks. IEEE Trans. Autom. Control 55(4), 922–938 (2010)

    Article  MathSciNet  Google Scholar 

  13. R. Olfati-Saber, J.A. Fax, R.M. Murray, Consensus and cooperation in networked multi-agent systems. Proc. IEEE 95(1), 215–233 (2007)

    Article  Google Scholar 

  14. W. Ren, R.W. Beard, Distributed Consensus in Multi-Vehicle Cooperative Control, Communications and Control Engineering (Springer, London, 2008)

    Book  MATH  Google Scholar 

  15. P. Wan, M.D. Lemmon, Event-triggered distributed optimization in sensor networks, in Symposium on Information Processing of Sensor Networks (San Francisco, CA, 2009), pp. 49–60

    Google Scholar 

  16. J. Wang, N. Elia, A control perspective for centralized and distributed convex optimization, in IEEE Conference on Decision and Control (Orlando, Florida, 2011), pp. 3800–3805

    Google Scholar 

  17. F. Zanella, D. Varagnolo, A. Cenedese, G. Pillonetto, L. Schenato, Newton-Raphson consensus for distributed convex optimization, in IEEE Conference on Decision and Control (Orlando, Florida, 2011), pp. 5917–5922

    Google Scholar 

  18. M. Zargham, A. Ribeiro, A. Jadbabaie, A distributed line search for network optimization, in American Control Conference (Montreal, Canada, 2012), pp. 472–477

    Google Scholar 

  19. F. Zhang, Matrix Theory. Basic Results and Techniques, Universitext, 2nd edn. (Springer, New York, 2011)

    Google Scholar 

  20. M. Zhu, S. Martínez, On distributed convex optimization under inequality and equality constraints. IEEE Trans. Autom. Control 57(1), 151–164 (2012)

    Article  Google Scholar 

Download references

Acknowledgments

Both authors wish to thank Jon Nicolás and Alexandra Cortés-Martínez for constant inspiration and joy. This work was partially supported by grants NSF CMMI-1300272 (JC) and AFOSR-11RSL548 (SM).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jorge Cortés .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Cortés, J., Martínez, S. (2015). Distributed Line Search for Multiagent Convex Optimization. In: Camlibel, M., Julius, A., Pasumarthy, R., Scherpen, J. (eds) Mathematical Control Theory I. Lecture Notes in Control and Information Sciences, vol 461. Springer, Cham. https://doi.org/10.1007/978-3-319-20988-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20988-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20987-6

  • Online ISBN: 978-3-319-20988-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics