Skip to main content

Preference-Based Decision Support in Software Engineering

  • Chapter
Value-Based Software Engineering

Abstract:

Throughout the lifecycle of a software system, complex decisions have to be made. One major source of complexity in decision problems is the need to simultaneously consider different, and sometimes conflicting, criteria. When a decision involves multiple criteria, it cannot be made in a purely objective way, but requires subjective judgement to evaluate the trade-offs between criteria. In the field of decision analysis, several methods have been developed to help decision makers to specify their preferences and apply them to a decision problem in a consistent way. In this chapter, we review several methods for multicriteria decision making, in particular additive weighting methods, methods based on aspiration levels, and outranking methods. We present the theoretical background of these methods, their specific ways of evaluating alternatives, and discuss their applicability to decision problems in software engineering. A concluding section discusses issues related to sensitivity analysis and the use of incomplete information.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barua, A., Kriebel, C. H., Mukhopadhyay, T.: Information Technologies and Business Value: An Analytic and Empirical Investigation. Inf Sys Research 6(1), pp 3–51

    Google Scholar 

  2. Blin, M.-J., Tsoukias, A.: Multi-Criteria Methodology Contribution to the Software Quality Evaluation. Software Quality Journal 9(2), pp 113–132

    Google Scholar 

  3. Boehm, B. W.: Value-Based Software Engineering. Software Engineering Notes 28(2), p 4

    Google Scholar 

  4. Brans, J. P., Mareschal, B., Vincke, P.: Promethee: A New Family of Outranking Methods in Multicriteria Analysis. In: Operational Research’ 84, ed by Brans, J. P. (North Holland, Amsterdam, 1984), pp 477–490

    Google Scholar 

  5. Carlsson, C., Fullér, R.: Fuzzy Reasoning in Decision Making and Optimization (Physica, Heidelberg 2002)

    Book  MATH  Google Scholar 

  6. Chankong, V., Haimes, Y. Y.: Multiobjective Decision Making: Theory and Methodology (North Holland, Amsterdam 1983)

    MATH  Google Scholar 

  7. Charnes, A., Cooper, W. W.: Management Models and Industrial Applications of Linear Programming (J. Wiley & Sons, New York 1961)

    MATH  Google Scholar 

  8. Charnes, A., Cooper, W. W., Ferguson, R. O.: Optimal Estimation of Executive Compensation by Linear Programming. Manage. Sci. 1(2), pp 138–151

    Google Scholar 

  9. Charnetski, J. R., Soland, R. M.: Multiple-Attribute Decision Making With Partial Information: The Comparative Hypervolume Criterion. Nav. Res. Logist. Q 25, pp 279–288

    Google Scholar 

  10. Crama, Y., Hansen, P.: An Introduction to the ELECTRE Research Programme. In: Essays and Surveys on Multiple Criteria Decision Making, ed by Hansen, P. (Springer, Berlin, 1983), pp 31–42

    Chapter  Google Scholar 

  11. DeLone, W. H., McLean, E. R.: Information Systems Success: The Quest for the Dependent Variable. Inf Sys Research 3(1), pp 60–95

    Google Scholar 

  12. Dias, L. C., Climaco, J. C.: On Computing ELECTRE’s Credibility Indices under Partial Information. J. Multi-Criteria Dec. Anal. 8(2), pp 74–92

    Google Scholar 

  13. Dias, L. C., Mousseau, V., Figueira, J., Climaco, J. C.: An Aggregation/Disaggregation Approach to obtain Robust Conclusions with ELECTRE TRI. Eur. J. Oper. Res 138(2), pp 332–348

    Google Scholar 

  14. Evans, J. R.: Sensitivity Analysis in Decision Theory. Decis Sci 15(2), pp 239–247

    Google Scholar 

  15. Farbey, B., Land, F. F., Targett, D.: A Taxonomy of Information Systems Applications: The Benefits’ Evaluation Ladder. Eur. J. Inf. Systs. 4(1), pp 41–50

    Google Scholar 

  16. Forgionne, G.: An AHP model of DSS effectiveness. Eur. J. Inf. Systs. 8(2), pp 95–106

    Google Scholar 

  17. Grauer, M., Lewandowski, A., Wierzbicki, A. P.: DIDASS — Theory, Implementation and Experiences. In: Interactive Decision Analysis, ed by Wierzbicki, A. P. (Springer, Berlin, 1984), pp 22–30

    Chapter  Google Scholar 

  18. Hwang, C.-L., Masud, A. S.: Multiple Objective Decision Making — Methods and Applications A State-of-the-Art Survey (Springer, Berlin 1979)

    Book  MATH  Google Scholar 

  19. Hwang, C.-L., Yoon, K.: Multiple Attribute Decision Making — Methods and Applications: A State of the Art Survey (Springer, Berlin 1981)

    Book  Google Scholar 

  20. Jain, H. K., Tanniru, M. R., Fazlollahi, B.: MCDM Approach for Generating and Evaluating Alternatives in Requirement Analysis. Inf Sys Research 2(3), pp 223–239

    Google Scholar 

  21. Keeney, R. L., Raiffa, H.: Decisions with Multiple Objectives: Preferences and Value Tradeoffs (J. Wiley & Sons, New York 1976)

    Google Scholar 

  22. Kim, C. S., Yoon, Y.: Selection of a Good Expert System Shell for Instructional Purposes in Business. Inf Manage 23(5), pp 249–262

    Google Scholar 

  23. Kim, J.: Hierarchical Structure of Intranet Functions and Their Relative Importance: Using the Analytic Hierarchy Process for Virtual Organizations. Decis. Support Syst. 23(1), pp 59–74

    Google Scholar 

  24. Korhonen, P., Wallenius, J.: A Pareto Race. Nav. Res. Logist. 35(6), pp 615–623

    Google Scholar 

  25. Lai, V. S., Trueblood, R. P., Wong, B. K.: Software Selection: A Case Study of the Application of the Analytical Hierarchical Process to the Selection of a Multimedia Authoring System. Inf Manage 36(4), pp 221–232

    Google Scholar 

  26. Lai, V. S., Wong, B. K., Cheung, W.: Group Decision Making in a Multiple Criteria Environment: A Case using the AHP in Software Selection. Eur. J. Oper. Res 137(1), pp 134–144

    Google Scholar 

  27. Lawrence, K. D., Marose, R. A., Lawrence, S. M.: Multiple Goal Portfolio Analysis Model for the Selection of MIS Projects. In: Essays and Surveys on Multiple Criteria Decision Making, ed by Hansen, P. (Springer, Berlin, 1983), pp 229–237

    Chapter  Google Scholar 

  28. (Le Teno and Mareschal, 1998)_Le Teno, J. F., Mareschal, B.: An Interval Version of PROMETHEE for the Comparison of Building Products’ Design with Ill-defined Data on Environmental Quality. Eur. J. Oper. Res 109(2), pp 522–529

    Google Scholar 

  29. Lee, C. W., Kwak, N. K.: Information Resource Planning for a Health-Care System Using an AHP-based Goal Programming Method. J. Opl Res. Soc. 50(12), pp 1191–1198

    Google Scholar 

  30. Lee, J., Kim, S.: Using Analytic Network Process and Goal Programming for Interdependent Information System Project Selection. Comput. and Ops. Res. 27(4), pp 367–382

    Google Scholar 

  31. Lewandowski, A., Wierzbicki, A. P.: Decision Support Systems Using Reference Point Optimization. In: Aspiration Based Decision Support Systems, ed by Lewandowski, A. and Wierzbicki, A. P. (Springer, Berlin, 1989), pp 3–20 4 Preference-Based Decision Support in Software Engineering 87

    Chapter  Google Scholar 

  32. Mamaghani, F.: Evaluation and Selection of an Antivirus and Content Filtering Software. Information Management and Computer Security 10(1), pp 28–32

    Google Scholar 

  33. Mareschal, B.: Weight Stability Intervals in Multicriteria Decision Aid. Eur. J. Oper. Res 33(1), pp 54–64

    Google Scholar 

  34. Miettinen, K., Salminen, P.: Decision-aid for Discrete Multiple Criteria Decision Making Problems with Imprecise Data. Eur. J. Oper. Res 119(1), pp 50–60

    Google Scholar 

  35. Muralidhar, K., Santhanam, R., Wilson, R. L.: Using the Analytic Hierarchy Process for Information System Project Selection. Inf Manage 18(2), pp 87–95

    Google Scholar 

  36. Park, K. S., Kim, S. H.: Tools for Interactive Multiattribute Decisionmaking with Incompletely Identified Information. Eur. J. Oper. Res 98(1), pp 111–123

    Google Scholar 

  37. Paschetta, E. and Tsoukias, A.: A Real-World MCDA Application: Evaluating Software. J. Multi-Criteria Dec. Anal. 9(5), pp 205–225

    Google Scholar 

  38. Phillips-Wren, G. E., Hahn, E. D., Forgionne, G. A.: A Multiple-Criteria Framework for Evaluation of Decision Support Systems. Omega 32(4), pp 323–332

    Google Scholar 

  39. Pomerol, J.-C., Barba-Romero, S.: Multicriterion Decision in Management: Principles and Practice (Kluwer, 2000)

    Google Scholar 

  40. Rios Insua, D., French, S.: A Framework for Sensitivity Analysis in Discrete Multi-Objective Decision-Making. Eur. J. Oper. Res 54(2), pp 176–190

    Google Scholar 

  41. Roper-Lowe, G. C., Sharp, J. A.: The Analytic Hierarchy Process and Its Application to an Information Technology Decision. J. Opl Res. Soc. 41(1), pp 49–59

    Google Scholar 

  42. Roubens, M.: Choice Procedures in Fuzzy Multicriteria Decision Analysis based on Pairwise Comparisons. Fuzzy Sets Syst. 84(2), pp 135–142

    Google Scholar 

  43. Roy, B.: The Outranking Approach and the Foundations of ELECTRE Methods. Theory Decis. 31, pp 49–73

    Google Scholar 

  44. Roy, B., Vanderpooten, D.: The European School of MCDA: Emergence, Basic Features and Current Works. J. Multi-Criteria Dec. Anal. 5(1), pp 22–36

    Google Scholar 

  45. Roy, B., Vincke, P.: Relational Systems of Preference with One or More Pseudo-Criteria: Some New Concepts and Results. Manage. Sci. 30(11), pp 1323–1335

    Google Scholar 

  46. Saaty, T. L.: The Analytic Hierarchy Process (McGraw-Hill, New York 1980)

    MATH  Google Scholar 

  47. Santhanam, R., Guimaraes, T.: Assessing the Quality of Institutional DSS. Eur. J. Inf. Systs. 4(3), pp 159–170

    Google Scholar 

  48. Sarkis, J., Sundarraj, R. P.: Evaluating Componentized Enterprise Information Technologies: A Multiattribute Modeling Approach. Inf Sys Frontiers 5(3), pp 303–320

    Google Scholar 

  49. Schniederjans, M. J., Wilson, R. L.: Using the Analytic Hierarchy Process and Goal Programming for Information System Project Selection. Inf Manage 20(5), pp 333–342

    Google Scholar 

  50. Schoemaker, P. J. H., Waid, C. C.: An Experimental Comparison of Different Approaches to Determining Weights in Additive Utility Models. Manage. Sci. 28, pp 182–196

    Google Scholar 

  51. Stamelos, I., Vlahavas, I., Refanidis, I., Tsoukias, A.: Knowledge Based Evaluation of Software Systems: A Case Study. Information and Software Technology 42(5), pp 333–345

    Google Scholar 

  52. Vetschera, R.: Sensitivity Analysis for the ELECTRE Multicriteria Method. Z. Oper. Res. 30, pp B 99–B 117

    Google Scholar 

  53. Vetschera, R.: An Interactive Outranking System for Multi-Attribute Decision Making. Comput. and Ops. Res. 15(4), pp 311–322

    Google Scholar 

  54. Vetschera, R.: Estimating Aspiration Levels from Discrete Choices — Computational Techniques and Experiences. Eur. J. Oper. Res 76(3), pp 455–465

    Google Scholar 

  55. Vetschera, R.: A Recursive Algorithm for Volume-Based Sensitivity Analysis of Linear Decision Models. Comput. and Ops. Res. 24(5), pp 477–491

    Google Scholar 

  56. (von Winterfeldt and Edwards, 1986)_von Winterfeldt, D., Edwards, W.: Decision Analysis and Behavioral Research (Cambridge University Press, 1986)

    Google Scholar 

  57. Weber, M.: Decision Making with Incomplete Information. Eur. J. Oper. Res 28(1), pp 44–57

    Google Scholar 

  58. Weber, M., Eisenführ, F., von Winterfeldt, D.: Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement. Manage. Sci. 34, pp 431–445

    Google Scholar 

  59. Wierzbicki, A. P.: On the Completeness and Constructiveness of Parametric Characterizations to Vector Optimization Problems. OR Spektrum 8, pp 73–87

    Google Scholar 

  60. Wolters, W. T. M., Mareschal, B.: Novel Types of Sensitivity Analysis for Additive MCDM Methods. Eur. J. Oper. Res 81(2), pp 281–290

    Google Scholar 

  61. Zimmermann, H.-J.: Fuzzy Programming and Linear Programming with Several Objective Functions. Fuzzy Sets Syst. 1(1), pp 45–55

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Vetschera, R. (2006). Preference-Based Decision Support in Software Engineering. In: Biffl, S., Aurum, A., Boehm, B., Erdogmus, H., Grünbacher, P. (eds) Value-Based Software Engineering. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-29263-2_4

Download citation

  • DOI: https://doi.org/10.1007/3-540-29263-2_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-25993-0

  • Online ISBN: 978-3-540-29263-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics