BEHAVIOURAL INSIGHTS FROM BIG DATA MULTIMODAL ANALYSIS
Fabio Angeletti, Ettore Di Micco
Obiettivi formativi
This course aims to equip students with the ability to extract, integrate, and interpret behavioural insights from diverse data modalities, such as text, images, audio, and structured digital traces, to inform marketing decisions. Students will learn how to apply machine learning and data visualization techniques to real-world behavioural data, critically assess ethical implications, and communicate findings effectively through dashboards and storytelling. The course emphasizes hands-on analysis, critical thinking, and the integration of behavioural theory with advanced data techniques.
Prerequisiti
Prior knowledge on basic data manipulation, and data visualization. Basic proficiency in data-driven reasoning is essential.
Risultati di apprendimento attesi
By the end of the course, students will be able to identify and integrate multimodal data sources relevant to behavioural analysis in marketing contexts. They will be able to apply appropriate machine learning techniques to extract behavioural insights, evaluate the ethical implications of their analyses, and communicate results effectively using advanced data visualization and storytelling methods. Students will also develop the ability to critically assess dashboards and predictive models, design basic behavioural experiments, and formulate data-driven marketing strategies grounded in consumer behaviour evidence.
Contenuti Del Corso
The course covers the collection, integration, and analysis of behavioural data from multiple modalities, including text, image, audio sources. Topics include multimodal data fusion, sentiment and emotion analysis, visual content analytics, behavioural clustering, and recommender systems. Emphasis is placed on ethical and legal considerations, such as GDPR and responsible AI use. The course also addresses advanced data visualization, storytelling techniques, and the design of behavioural experiments. Case studies and hands-on project work will guide students in applying these methods to real-world marketing problems.
Testi Di Riferimento
All the material needed for the course will be available on the website of the course.
Metodologie Didattiche
Most lectures will integrate theoretical foundations with practical exercises. Working in teams, students will develop proof-of-concept solutions in response to a group project challenge assigned by the instructors. These solutions will be presented in class, with the goal of strengthening both their understanding of AI algorithms and their communication skills.
Modalità di verifica dell'apprendimento
Students will be evaluated based on two mandatory components: a mid term individual written exam (1/3) and a group project (2/3). Please note that the group project must be presented in person, and its completion is a strict requisite to obtain an evaluation. Students who are unable to attend lectures and non-attending students are required to complete the group project and sustain a written exam. Additionally, non-attending students are responsible for reviewing all of the material provided through the course webiste and studying the designated supplementary texts if any.
Criteri per l’assegnazione dell’elaborato finale
A thesis will be assigned (upon specific request to the instructor) to students who have average grade >27/30 and who demonstrate a serious and motivated interest in the course topics.
Settimana 1
Course Introduction and Expectations
Overview of course objectives, structure, grading
Examples of multimodal behavioural data in marketing
Behavioural Science Meets Big Data Behavioural marketing frameworks: biases, decision processes
Mapping psychological insights onto digital traces
Intro on KNIME / Orange
Settimana 2
Types of Data in Behavioural Analysis
Structured (CRM, survey), unstructured (text, image), semi-structured
Digital Footprints and Tracking
Sources: clickstream, app usage, social media, sensors, eye-tracking
Settimana 3
What Is Multimodal Data?
Definitions, challenges (synchronization, sparsity), relevance
Hands on KNIME / Orange
Integration Techniques
Feature-level vs. decision-level fusion, entity resolution, schema alignment
Settimana 4
Text Mining in Marketing
Preprocessing, keyword extraction, topic modeling
Hands on KNIME / Orange
Sentiment and Emotion Analysis
Lexicon-based vs. ML-based sentiment classification in KNIME/Orange or Python
Settimana 5
Visual Content and Engagement: Computer vision basics: image tagging, feature extraction, branding cues
Case Study: Instagram, Pinterest, YouTube: Analyzing campaign images and consumer response through visual features
Settimana 6
Behaviour Prediction with Machine Learning: Predicting churn, purchase, clicks using multimodal features
Recommendation Systems for Behavioural Targeting: Collaborative filtering, hybrid models, explainability
Settimana 7
Customer Behavioural Clustering: Sequence mining, time-series patterns, path analysis
Beyond RFM: From Descriptive to Predictive Clustering: Unsupervised learning with multimodal inputs
Settimana 8
A/B Testing and Behavioural Experiments: Test design, KPIs, interpretation pitfalls
Uplift Modeling and Optimization: How to identify treatment-sensitive groups
Settimana 9
Designing Insightful Dashboards: Dashboard best practices, misleading visualizations, persuasion techniques
Critiquing and Improving Visualizations: Student-led critique session on real-world dashboards
Settimana 10
Voice and Audio Cues in Behavioural Analytics: Emotion from tone, call center analysis, acoustic signal features
Multimodal Emotion Recognition: Combining voice, facial expressions, and text (overview and demo)
Settimana 11
Ethics in Behavioural Data Use: Dark patterns, manipulative nudging, transparency, bias
Legal Guidelines and Responsible AI: GDPR, AI Act, consent mechanisms, fairness in predictions
Settimana 12
Exam preparation: Practice oral exams, integration of concepts, Q&A