Lionsolver Learning From Data Homework

[Fall 2014] Topics in Artificial Intelligence: Machine Learning with Large-scale Data

General Information


This graduate-level course covers machine-learning algorithms, programming environments, and software frameworks that are designed to effectively deal with large-scale (i.e., big) data.

Prerequisites: A previous course on machine learning or data mining. A strong knowledge of algorithms and programming (Java, C, and scripting/dynamic languages).



  • (textbook) Kevin Murphy, Machine Learning: A Probabilistic Perspective. ISBN 0262018020, MIT Press, 2012.
  • (textbook) Christopher Bishop, Pattern Recognition and Machine Learning. ISBN 0387310738, Springer 2006.
  • (textbook) Tom Mitchell, Machine Learning. ISBN 0070428077, McGraw-Hill, 1997.
  • (textbook, free on-line) Trevor Hastie, Robert Tibshirani and Jerome Friedman, Elements of Statistical Learning. ISBN 0387952845, Springer, 2009 (2nd edition).
  • (textbook, free on-line) David MacKay, Information Theory, Inference, and Learning Algorithms. ISBN 0521642981, Cambridge University Press, 2003.
  • (textbook, free on-line) Roberto Battiti and Mauro Brunato. The LION Way: Machine Learning plus Intelligent Optimization. Lionsolver, Inc. 2013.
  • Probability Review (David Blei, Princeton)
  • Probability Theory Review (Arian Maleki and Tom Do, Stanford)
  • Linear Algebra Tutorial (C.T. Abdallah, Penn)
  • Linear Algebra Review and Reference (Zico Kolter and Chuong Do, Stanford)
  • Statistical Data Mining Tutorials (Andrew Moore, Google/CMU)
  • Theoretical CS Cheat Sheet (Princeton)


You will be evaluated based on student presentations (40%) and a substantial semester-long project (60%). The project must include at least one big data set, at least one learning/mining algorithm, and a real-world application. For the project, you will need to prepare a proposal, give a presentation at the end of the semester, and write a final report. More details will be provided in class.

Notes, Policies, and Guidelines

Schedule / Syllabus (Subject to Change)

Some Similar Courses in Other Universities

  • 1.

    Rossi, F., van Beek, P., Walsh, T.: Handbook of Constraint Programming (Foundations of Artificial Intelligence). Elsevier Science Inc., New York (2006)Google Scholar

  • 2.

    Prosser, P.: Hybrid algorithms for the constraint satisfaction problem. Computational Intelligence 9, 268–299 (1993)CrossRefGoogle Scholar

  • 3.

    Ginsberg, M.: Dynamic backtracking. Journal of Artificial Intelligence Research 1, 25–46 (1993)MATHGoogle Scholar

  • 4.

    Jussien, N., Lhomme, O.: Local search with constraint propagation and conflict-based heuristics. Artif. Intell. 139(1), 21–45 (2002)MATHMathSciNetCrossRefGoogle Scholar

  • 5.

    Jégou, P., Terrioux, C.: Hybrid backtracking bounded by tree-decomposition of constraint networks. Artif. Intell. 146, 43–75 (2003)MATHCrossRefGoogle Scholar

  • 6.

    Lecoutre, C., Boussemart, F., Hemery, F.: Backjump-based techniques versus conflict-directed heuristics. In: 16th IEEE International Conference on Tools with Artificial Intelligence, ICTAI 2004, pp. 549–557. IEEE (2004)Google Scholar

  • 7.

    Boussemart, F., Hemery, F., Lecoutre, C., Sais, L.: Boosting systematic search by weighting constraints. ECAI 16, 146 (2004)Google Scholar

  • 8.

    Blet, L., Ndiaye, S.N., Solnon, C.: A generic framework for solving csps integrating decomposition methods. In: CP Doctoral Program, Quebec, Canada (2012)Google Scholar

  • 9.

    O’Mahony, E., Hebrard, E., Holland, A., Nugent, C., O’Sullivan, B.: Using case-based reasoning in an algorithm portfolio for constraint solving. In: Irish Conference on Artificial Intelligence and Cognitive Science (2008)Google Scholar

  • 10.

    Xu, L., Hoos, H., Leyton-Brown, K.: Hydra: Automatically configuring algorithms for portfolio-based selection. In: AAAI, vol. 10, pp. 210–216 (2010)Google Scholar

  • 11.

    Kadioglu, S., Malitsky, Y., Sellmann, M., Tierney, K.: Isac-instance-specific algorithm configuration. In: ECAI, vol. 215, pp. 751–756 (2010)Google Scholar

  • 12.

    Amadini, R., Gabbrielli, M., Mauro, J.: An empirical evaluation of portfolios approaches for solving CSPs. In: Gomes, C., Sellmann, M. (eds.) CPAIOR 2013. LNCS, vol. 7874, pp. 316–324. Springer, Heidelberg (2013)CrossRefGoogle Scholar

  • 13.

    Geschwender, D.J., Karakashian, S., Woodward, R.J., Choueiry, B.Y., Scott, S.D.: Selecting the appropriate consistency algorithm for csps using machine learning classifiers. In: Twenty-Seventh AAAI Conference on Artificial Intelligence (2013)Google Scholar

  • 14.

    Bacchus, F.: Extending forward checking. In: Dechter, R. (ed.) CP 2000. LNCS, vol. 1894, pp. 35–51. Springer, Heidelberg (2000)CrossRefGoogle Scholar

  • 15.

    Jussien, N., Debruyne, R., Boizumault, P.: Maintaining arc-consistency within dynamic backtracking. In: Dechter, R. (ed.) CP 2000. LNCS, vol. 1894, pp. 249–261. Springer, Heidelberg (2000)CrossRefGoogle Scholar

  • 16.

    Baker, A.B.: The hazards of fancy backtracking. In: AAAI, pp. 288–293 (1994)Google Scholar

  • 17.

    Zivan, R., Shapen, U., Zazone, M., Meisels, A.: Retroactive ordering for dynamic backtracking. In: CP, pp. 766–771 (2006)Google Scholar

  • 18.

    Pralet, C., Verfaillie, G.: Travelling in the world of local searches in the space of partial assignments. In: Régin, J.-C., Rueher, M. (eds.) CPAIOR 2004. LNCS, vol. 3011, pp. 240–255. Springer, Heidelberg (2004)CrossRefGoogle Scholar

  • 19.

    Kjaerulff, U.: Triangulation of graphs: Algorithms giving small total state space. Technical report, University of Aalborg (1990)Google Scholar

  • 20.

    Mackworth, A.K.: Consistency in networks of relations. Artificial intelligence 8(1), 99–118 (1977)MATHMathSciNetCrossRefGoogle Scholar

  • 21.

    Bessière, C., Régin, J.-C.: Refining the basic constraint propagation algorithm. In: IJCAI, vol. 1, pp. 309–315 (2001)Google Scholar

  • 22.

    Bessiere, C., Régin, J.-C.: Mac and combined heuristics: Two reasons to forsake fc (and cbj?) on hard problems. In: Freuder, E.C. (ed.) CP 1996. LNCS, vol. 1118, pp. 61–75. Springer, Heidelberg (1996)CrossRefGoogle Scholar

  • 23.

    Jégou, P., Ndiaye, S., Terrioux, C.: Dynamic heuristics for backtrack search on tree-decomposition of CSPs. In: IJCAI, pp. 112–117 (2007)Google Scholar

  • 24.

    Jégou, P., Ndiaye, S.N., Terrioux, C.: Strategies and Heuristics for Exploiting Tree-decompositions of Constraint Networks. In: Inference methods based on graphical structures of knowledge (WIGSK 2006), ECAI Workshop, pp. 13–18 (2006)Google Scholar

  • 25.

    Morara, M., Mauro, J., Gabbrielli, M.: Solving xcsp problems by using gecode. In: 26th Italian Conference on Computational Logic (CILC). CEUR Workshop Proceedings, vol. 810, pp. 401–405. (2011)Google Scholar

  • 26.

    Chen, X., Beek, P.v.: Conflict-directed backjumping revisited. Journal of Artificial Intelligence Research 14, 53–81 (2001)MATHMathSciNetGoogle Scholar

  • 27.

    Malitsky, Y., Mehta, D., O’Sullivan, B.: Evolving instance specific algorithm configuration. In: Symposium on Combinatorial Search, SOCS (2013)Google Scholar

  • 28.

    Battiti, R., Brunato, M.: The LION Way: Machine Learning plus Intelligent Optimization. Lionsolver Inc. (2013)Google Scholar

  • 29.

    Holmes, G., Donkin, A., Witten, I.H.: Weka: A machine learning workbench. In: Proceedings of the 1994 Second Australian and New Zealand Conference on Intelligent Information Systems, pp. 357–361. IEEE (1994)Google Scholar

  • 30.

    Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explorations Newsletter 11(1), 10–18 (2009)CrossRefGoogle Scholar

  • 31.

    Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using model trees for classification. Machine Learning 32(1), 63–76 (1998)MATHCrossRefGoogle Scholar

  • 32.

    Kadioglu, S., O’Mahony, E., Refalo, P., Sellmann, M.: Incorporating variance in impact-based search. In: Lee, J. (ed.) CP 2011. LNCS, vol. 6876, pp. 470–477. Springer, Heidelberg (2011)CrossRefGoogle Scholar

  • 33.

    Sakkout, H.E., Wallace, M.G., Richards, E.B.: An instance of adaptive constraint propagation. In: Freuder, E.C. (ed.) CP 1996. LNCS, vol. 1118, pp. 164–178. Springer, Heidelberg (1996)CrossRefGoogle Scholar

  • 34.

    Liberto, G.D., Kadioglu, S., Leo, K., Malitsky, Y.: Dash: Dynamic approach for switching heuristics. CoRR, abs/1307.4689 (2013)Google Scholar

  • 0 Replies to “Lionsolver Learning From Data Homework”

    Lascia un Commento

    L'indirizzo email non verrà pubblicato. I campi obbligatori sono contrassegnati *