Modeling Opponent Strategy in Multi-Issue Bilateral Automated Negotiation Using Machine Learning

Document Type : Original Article

Authors

1 MSc Graduate in Information Technology Engineering, Department of Computer Engineering, Faculty of Engineering, College of Farabi, University of Tehran, Iran

2 Department of Computer Engineering, Faculty of Engineering, College of Farabi, University of Tehran, Iran

Abstract

With the emergence of the World Wide Web, Electronic Commerce (E-commerce) has been growing rapidly in the past two decades. Intelligent agents play the main role in making the negotiation between different entities automatically.  Automated negotiation allows resolving opponent agents' mutual concerns to reach an agreement without the risk of losing individual profits. However, due to the unknown information about the opponent's strategies, automated negotiation is difficult. The main challenge is how to reveal the optimal information about the opponent's strategy during the negotiation process to propose the best counter-offer. In this paper, we design a buyer agent which can automatically negotiate with the opponent using artificial intelligence techniques and machine learning methods. The proposed buyer agent is designed to learn the opponent's strategies during the negotiation process using four methods: "Bayesian Learning", "Kernel Density Estimation", "Multilayer Perceptron Neural Network", and "Nonlinear Regression". Experimental results show that the use of machine learning methods increases the negotiation efficiency, which is measured and evaluated by parameters such as the rate agreement (RA), average buyer utility (ABU), average seller utility (ASU), average rounds (AR). Rate agreement and average buyer utility have increased from 58% to 74% and 90% to 94%, respectively, and average rounds have decreased from 10% to 0.04%.

Keywords

Main Subjects

References

  • Kenneth Laudon and Carol Traver. E-Commerce: Business, Technology, Society (3rd Edition). Prentice-Hall, Inc., USA, 2006.
  • Dave Chaffey. E-business and E-commerce Management: Strategy, Implementation and Practice. Pearson Education, 2007
  • Sarit Kraus. Automated negotiation and decision making in multiagent environments. In ECCAI Advanced Course on Artificial Intelligence, pages 150–172. Springer, 2001.
  • Peter Braun, Jakub Brzostowski, Gregory Kersten, Jin Baek Kim, Ryszard Kowalczyk, Stefan Strecker, and Rustam Vahidov. E-negotiation Systems and Software Agents: Methods, Models, and Applications, pages 271–300. Springer London, London, 2006.
  • Dean G Pruitt and Peter J Carnevale. Negotiation in social conflict. Buckingham, Open University Press, 1993.
  • Nicholas R Jennings, Peyman Faratin, Alessio R Lomuscio, Simon Parsons, Carles Sierra, and Michael Wooldridge. Automated negotiation: prospects, methods and challenges. International Journal of Group Decision and Negotiation, 10(2):199–215, 2001.
  • Shaheen Fatima, Sarit Kraus, and Michael Principles of automated negotiation. Cambridge University Press, 2014.
  • Tim Baarslag, Mark J.C. Hendrikx, Koen V. Hindriks, and Catholijn M. Jonker. Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Autonomous Agents and Multi-Agent Systems, 30(5):849–898, 9 2016.
  • Usha Kiruthika, Thamarai Selvi Somasundaram, and S. Kanaga Suba Raja. Lifecycle model of a negotiation agent: A survey of automated negotiation techniques. Group Decision and Negotiation, 9, 2020.
  • Park and S. Yang. An automated system based on incremental learning with applicability toward multilateral negotiations. In 2006 SICE-ICASE International Joint Conference, pages 6001–6006, 2006.
  • Dajun Zeng and Katia Sycara. Benefits of learning in negotiation. In Proceedings of the 14th National Conference on Artificial Intelligence, AAAI 97, pages 36–41, 1997.
  • Dajun Zeng and Katia Sycara. Bayesian learning in negotiation. International Journal of Human-Computer Studies, 48(1):125–141, 1998.
  • Jihang Zhang, Fenghui Ren, and Minjie Zhang. Bayesian-based preference prediction in bilateral multi-issue negotiation between intelligent agents. Knowledge-Based Systems, 84:108–120, 2015.
  • Jihang Zhang, Fenghui Ren, and M. Zhang. Prediction of the opponent's preference in bilateral multi-issue negotiation through bayesian learning. In ANAC@AAMAS, 2014.
  • Faezeh Eshragh, Mozhdeh Shahbazi, and Behrouz Far. Real-time opponent learning in automated negotiation using recursive bayesian filtering. Expert Systems with Applications, 128:28–53, 2019.
  • Kashif Imran, Jiangfeng Zhang, Anamitra Pal, Abraiz Khattak, Kafait Ullah, and Sherjeel Mahmood Baig. Bilateral negotiations for electricity market by adaptive agent-tracking strategy. Electric Power Systems Research, 186:106390, 2020.
  • Chao Yu, Fenghui Ren, and Minjie Zhang. Bilateral Negotiation Model Based on Bayesian Learning, pages 75–93. Springer Berlin Heidelberg, Berlin, Heidelberg, 2013.
  • Chongming Hou. Predicting agents tactics in automated negotiation. In Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT'04, pages 127–133, 2004.
  • Haithem Mezni and Mokhtar Sellami. A negotiation-based service selection approach using swarm intelligence and kernel density estimation. Software: Practice and Experience, 48(6):1285–1311, 2018.
  • Robert M. Coehoorn and Nicholas R. Jennings. Learning on opponent's preferences to make effective multi-issue negotiation trade-offs. In Proceedings of the 6th International Conference on Electronic Commerce, ICEC '04, page 59–68, New York, NY, USA, 2004.
  • Dirk C. Moosmayer, Alain Yee-Loong Chong, Martin J. Liu, and Bjoern Schuppar. A neural network approach to predicting price negotiation outcomes in business-to-business contexts. Expert Systems with Applications, 40(8):3028 – 3035, 2013.
  • Chun Ching Lee and C. Ou-Yang. A neural networks approach for forecasting the supplier's bid prices in supplier selection negotiation process. Expert Systems with Applications, 36(2, Part 2):2961–2970, 2009.
  • Pallavi Bagga, Nicola Paoletti, Bedour Alrayes, and Kostas Stathis. A deep reinforcement learning approach to concurrent bilateral negotiation, In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Pages 297-303, 2020.
  • M. Farag, S. E. AbdelRahman, R. Bahgat, and A. M. A-Moneim. Towards KDE mining approach for multiagent negotiation. In 2010 The 7th International Conference on Informatics and Systems (INFOS), pages 1–7, 2010.
  • Peyman Faratin, Carles Sierra, and Nick R. Jennings. Negotiation decision functions for autonomous agents. Robotics and Autonomous Systems, 24(3):159 – 182, 1998.
  • Mohammad Irfan Bala, Sheetal Vij, and Debajyoti Mukhopadhyay. Negotiation life cycle: An approach in e-negotiation with prediction. In Suresh Chandra Satapathy, P. S. Avadhani, Siba K. Udgata, and Sada- sivuni Lakshminarayana, editors, ICT and Critical Infrastructure: Proceedings of the 48th Annual Convention of Computer Society of India, Vol I, pages 505–512, Cham, 2014.
  • Kostas Kolomvatsos and Stathes Hadjieftymiades. On the use of particle swarm optimization and kernel density estimator in concurrent negotiations. Information Sciences, 262:99 –116, 2014.
  • Binmore, K., Vulkan, N. Applying game theory to automated negotiation. NETNOMICS: Economic Research and Electronic Networking 1: 1–9, 1999.
  • Kolomvatsos, Kostas & Panagidi, Kakia & Neokosmidis, Ioannis & Varoutas, Dimitris & Hadjiefthymiades, Stathes. Automated Concurrent Negotiations: An Artificial Bee Colony Approach. Electronic Commerce Research and Applications.19:56-69, 2016.
  • Fatemeh Mohammadi-Ashnani, Zahra Movahedi, Kazim Fouladi-Ghaleh. Using Bayesian Learning for Opponent Modeling in Multiagent Automated Negotiation, Proceedings of the 5th International Conference on Web Research, ICWR 2019, University of Science and Culture, Tehran, Iran, 2019.

 

International Journal of Web Research
Volume 3, Issue 2
Autumn-Winter
December 2020
Pages 16-25

Files

Share

How to cite

Statistics