Skip to main content
Erschienen in: Arabian Journal for Science and Engineering 9/2021

23.04.2021 | Research Article-Computer Engineering and Computer Science

EnPSO: An AutoML Technique for Generating Ensemble Recommender System

verfasst von: Garima Gupta, Rahul Katarya

Erschienen in: Arabian Journal for Science and Engineering | Ausgabe 9/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the explosive increase in data on the web, recommending items to users is becoming more complex. In recent times, the best recommender systems have come from ensemble learning, which combines many models and techniques to generate recommendations that can draw the best characteristics of the constituent models. These ensemble models can improve accuracy, and they are also able to reduce the biases that come with each model. However, the massive number of permutations in which recommendation models are combined to create an ensemble model adds another layer of complexity to an already complex problem. Thus, in line with the recent trend in Automated Machine Learning (AutoML) aimed at reducing the complexity associated with model selection, there is a need for a machine learning framework that can learn the best ensemble model for a given problem given the base models. We proposed a system Ensemble with Particle Swarm Optimization, which intelligently optimizes the recommendations by identifying the best ensemble architecture for the data at hand. Our proposed AutoML system can improve recommendations for the MovieLens dataset by combining the results from base techniques without any user effort. The major challenge in creating such a system is to develop a framework for generating ensemble models and finding an efficient way to reach the best performing model since the search space can be vast. To overcome this challenge, we have used hierarchical models to generate ensembles and Particle Swarm Optimization to find the optimal ensemble models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Jamali, M.; Ester, M.: TrustWalker: a random walk model for combining trust-based and item-based recommendation. In: KDD ’09 Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 397–406 (2009). Jamali, M.; Ester, M.: TrustWalker: a random walk model for combining trust-based and item-based recommendation. In: KDD ’09 Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 397–406 (2009).
3.
Zurück zum Zitat Yuan, J.; Shalaby, W.; Korayem, M.; Lin, D.; AlJadda, K.; Luo, J.: Solving cold-start problem in large-scale recommendation engines: {A} deep learning approach. CoRR. abs/1611.0, 1901–1910 (2016) Yuan, J.; Shalaby, W.; Korayem, M.; Lin, D.; AlJadda, K.; Luo, J.: Solving cold-start problem in large-scale recommendation engines: {A} deep learning approach. CoRR. abs/1611.0, 1901–1910 (2016)
5.
Zurück zum Zitat Zoph, B.; Le, Q.V.: Neural architecture search with reinforcement learning. Cvpr 2019, 1–11 (2019) Zoph, B.; Le, Q.V.: Neural architecture search with reinforcement learning. Cvpr 2019, 1–11 (2019)
6.
Zurück zum Zitat Yao, Q.; Wang, M.; Chen, Y.; Dai, W.; Li, Y.F.; Tu, W.W.; Yang, Q.; Yu, Y.: Taking human out of learning applications: a survey on automated machine learning (2018). arXiv:1810.13306 Yao, Q.; Wang, M.; Chen, Y.; Dai, W.; Li, Y.F.; Tu, W.W.; Yang, Q.; Yu, Y.: Taking human out of learning applications: a survey on automated machine learning (2018). arXiv:​1810.​13306
7.
Zurück zum Zitat Zöller, M.A.; Huber, M.F.: Benchmark and survey of automated machine learning frameworks. J. Artif. Intell. Res. 70, 409–472 (2021)MathSciNetCrossRef Zöller, M.A.; Huber, M.F.: Benchmark and survey of automated machine learning frameworks. J. Artif. Intell. Res. 70, 409–472 (2021)MathSciNetCrossRef
8.
Zurück zum Zitat He, X.; Zhao, K.; Chu, X.: AutoML: a survey of the state-of-the-art. Knowl.-Based Syst. 212, 106622 (2021)CrossRef He, X.; Zhao, K.; Chu, X.: AutoML: a survey of the state-of-the-art. Knowl.-Based Syst. 212, 106622 (2021)CrossRef
10.
Zurück zum Zitat Yu, K.; Schwaighofer, A.; Tresp, V.; Ma, W.; Zhang, H.: Collaborative ensemble learning: combining collaborative and content-based information filtering via hierarchical bayes. In: UAI’03 Proceedings of the Ninth Conference of Uncertainty in Artificial Intelligence, pp. 353–360 (2003). Yu, K.; Schwaighofer, A.; Tresp, V.; Ma, W.; Zhang, H.: Collaborative ensemble learning: combining collaborative and content-based information filtering via hierarchical bayes. In: UAI’03 Proceedings of the Ninth Conference of Uncertainty in Artificial Intelligence, pp. 353–360 (2003).
11.
Zurück zum Zitat Schclar, A.; Tsikinovsky, A.; Rokach, L.; Meisels, A.; Antwarg, L.: Ensemble methods for improving the performance of neighborhood-based collaborative filtering. In: RecSys’09—Proceedings of the 3rd ACM Conference on Recommender Systems, pp. 261–264 (2009). Schclar, A.; Tsikinovsky, A.; Rokach, L.; Meisels, A.; Antwarg, L.: Ensemble methods for improving the performance of neighborhood-based collaborative filtering. In: RecSys’09—Proceedings of the 3rd ACM Conference on Recommender Systems, pp. 261–264 (2009).
12.
Zurück zum Zitat Fortes, A.; Manzato, M.: Ensemble learning in recommender systems: combining multiple user interactions for ranking personalization. In: WebMedia 2014—Proceedings of the 20th Brazilian Symposium on Multimedia and the Web, pp. 47–54 (2014). https://doi.org/10.1145/2664551.2664556 Fortes, A.; Manzato, M.: Ensemble learning in recommender systems: combining multiple user interactions for ranking personalization. In: WebMedia 2014—Proceedings of the 20th Brazilian Symposium on Multimedia and the Web, pp. 47–54 (2014). https://​doi.​org/​10.​1145/​2664551.​2664556
14.
Zurück zum Zitat Srikanth, T.; Shashi, M.: A scalable ensemble architecture for collaborative filtering in recommender systems. Int. J. Appl. Eng. Res. 11, 5103–5109 (2016) Srikanth, T.; Shashi, M.: A scalable ensemble architecture for collaborative filtering in recommender systems. Int. J. Appl. Eng. Res. 11, 5103–5109 (2016)
17.
Zurück zum Zitat Tiemann, M.; Pauws, S.; Vignoli, F.: Ensemble learning for hybrid music recommendation. In: Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007, pp. 179–180 (2007) Tiemann, M.; Pauws, S.; Vignoli, F.: Ensemble learning for hybrid music recommendation. In: Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007, pp. 179–180 (2007)
18.
Zurück zum Zitat Wu, M.: Collaborative filtering via ensembles of matrix factorizations. In: KDD Cup and Workshop 2007, pp. 43–47 (2007) Wu, M.: Collaborative filtering via ensembles of matrix factorizations. In: KDD Cup and Workshop 2007, pp. 43–47 (2007)
30.
Zurück zum Zitat Lommatzsch, A.: Real-time news recommendation using context-aware ensembles. Lecture Notes Computer Science (Including Subseries Lecture Notes Artificial Intelligence. Lecture Notes Bioinformatics). 8416 LNCS, pp. 51–62 (2014). https://doi.org/https://doi.org/10.1007/978-3-319-06028-6_5 Lommatzsch, A.: Real-time news recommendation using context-aware ensembles. Lecture Notes Computer Science (Including Subseries Lecture Notes Artificial Intelligence. Lecture Notes Bioinformatics). 8416 LNCS, pp. 51–62 (2014). https://​doi.​org/​https://​doi.​org/​10.​1007/​978-3-319-06028-6_​5
44.
Zurück zum Zitat Wang, J.; De Vries, A.P.; Reinders, M.J.T.: Unifying user-based and item-based collaborative filtering approaches by similarity fusion. In: Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and development in information 2006, pp. 501–508 (2006). https://doi.org/10.1145/1148170.1148257 Wang, J.; De Vries, A.P.; Reinders, M.J.T.: Unifying user-based and item-based collaborative filtering approaches by similarity fusion. In: Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and development in information 2006, pp. 501–508 (2006). https://​doi.​org/​10.​1145/​1148170.​1148257
45.
Zurück zum Zitat Vozalis, M.G.; Margaritis, K.G.: Applying SVD on generalized item-based filtering. Int. J. Comput. Sci. Appl. Technomath. Res. Found. 3, 27–51 (2006) Vozalis, M.G.; Margaritis, K.G.: Applying SVD on generalized item-based filtering. Int. J. Comput. Sci. Appl. Technomath. Res. Found. 3, 27–51 (2006)
46.
Zurück zum Zitat Marlin, B.M.: Modeling user rating profiles for collaborative filtering. In: Advances in Neural Information Processing Systems, vol. 16, pp. 627–634 (2003) Marlin, B.M.: Modeling user rating profiles for collaborative filtering. In: Advances in Neural Information Processing Systems, vol. 16, pp. 627–634 (2003)
49.
Zurück zum Zitat Bühlmann, P.: Bagging, boosting and ensemble methods. In: Handbook of Computational Statistics, pp. 985–1022. Springer, Berlin, Heidelberg (2012)CrossRef Bühlmann, P.: Bagging, boosting and ensemble methods. In: Handbook of Computational Statistics, pp. 985–1022. Springer, Berlin, Heidelberg (2012)CrossRef
50.
51.
Zurück zum Zitat Beygelzimer, A.; Hazan, E.; Kale, S.; Luo, H.: Online gradient boosting. Adv. Neural Inf. Process. Syst. 2015, 2458–2466 (2015) Beygelzimer, A.; Hazan, E.; Kale, S.; Luo, H.: Online gradient boosting. Adv. Neural Inf. Process. Syst. 2015, 2458–2466 (2015)
52.
Zurück zum Zitat Dembczyñski, K.; Cheng, W.; Hüllermeier, E.: Bayes optimal multilabel classification via probabilistic classifier chains. In: ICML 2010—Proceedings, 27th International Conference Machine Learning, pp. 279–286 (2010) Dembczyñski, K.; Cheng, W.; Hüllermeier, E.: Bayes optimal multilabel classification via probabilistic classifier chains. In: ICML 2010—Proceedings, 27th International Conference Machine Learning, pp. 279–286 (2010)
63.
Zurück zum Zitat Tsutsui, S.; Yamamura, M.; Higuchi, T.: Multi-parent recombination with simplex crossover in real coded genetic algorithms. Proc. Genet. Evol. Comput. Conf. 1, 657–664 (1999) Tsutsui, S.; Yamamura, M.; Higuchi, T.: Multi-parent recombination with simplex crossover in real coded genetic algorithms. Proc. Genet. Evol. Comput. Conf. 1, 657–664 (1999)
67.
Metadaten
Titel
EnPSO: An AutoML Technique for Generating Ensemble Recommender System
verfasst von
Garima Gupta
Rahul Katarya
Publikationsdatum
23.04.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Arabian Journal for Science and Engineering / Ausgabe 9/2021
Print ISSN: 2193-567X
Elektronische ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05670-z

Weitere Artikel der Ausgabe 9/2021

Arabian Journal for Science and Engineering 9/2021 Zur Ausgabe

Research Article-Computer Engineering and Computer Science

Software Fault Prediction Using LSSVM with Different Kernel Functions

Research Article-Computer Engineering and Computer Science

Design of Spline–Evolutionary Computing Paradigm for Nonlinear Thin Film Flow Model

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.