BEHAVIOURAL INSIGHTS FROM BIG DATA MULTIMODAL ANALYSIS

Fabio Angeletti, Ettore Di Micco

Obiettivi formativi

This course aims to equip students with the ability to extract, integrate, and interpret behavioural insights from diverse data modalities, such as text, images, audio, and structured digital traces, to inform marketing decisions. Students will learn how to apply machine learning and data visualization techniques to real-world behavioural data, critically assess ethical implications, and communicate findings effectively through dashboards and storytelling. The course emphasizes hands-on analysis, critical thinking, and the integration of behavioural theory with advanced data techniques.

Prerequisiti

Prior knowledge on basic data manipulation, and data visualization. Basic proficiency in data-driven reasoning is essential.

Risultati di apprendimento attesi

By the end of the course, students will be able to identify and integrate multimodal data sources relevant to behavioural analysis in marketing contexts. They will be able to apply appropriate machine learning techniques to extract behavioural insights, evaluate the ethical implications of their analyses, and communicate results effectively using advanced data visualization and storytelling methods. Students will also develop the ability to critically assess dashboards and predictive models, design basic behavioural experiments, and formulate data-driven marketing strategies grounded in consumer behaviour evidence.

Contenuti Del Corso

The course covers the collection, integration, and analysis of behavioural data from multiple modalities, including text, image, audio sources. Topics include multimodal data fusion, sentiment and emotion analysis, visual content analytics, behavioural clustering, and recommender systems. Emphasis is placed on ethical and legal considerations, such as GDPR and responsible AI use. The course also addresses advanced data visualization, storytelling techniques, and the design of behavioural experiments. Case studies and hands-on project work will guide students in applying these methods to real-world marketing problems.

Testi Di Riferimento

All the material needed for the course will be available on the website of the course.

Metodologie Didattiche

Most lectures will integrate theoretical foundations with practical exercises. Working in teams, students will develop proof-of-concept solutions in response to a group project challenge assigned by the instructors. These solutions will be presented in class, with the goal of strengthening both their understanding of AI algorithms and their communication skills.

Modalità di verifica dell'apprendimento

Students will be evaluated based on two mandatory components: a mid term individual written exam (1/3) and a group project (2/3). Please note that the group project must be presented in person, and its completion is a strict requisite to obtain an evaluation. Students who are unable to attend lectures and non-attending students are required to complete the group project and sustain a written exam. Additionally, non-attending students are responsible for reviewing all of the material provided through the course webiste and studying the designated supplementary texts if any.

Criteri per l’assegnazione dell’elaborato finale

A thesis will be assigned (upon specific request to the instructor) to students who have average grade >27/30 and who demonstrate a serious and motivated interest in the course topics. 

Settimana 1

Course Introduction and Expectations Overview of course objectives, structure, grading Examples of multimodal behavioural data in marketing Behavioural Science Meets Big Data Behavioural marketing frameworks: biases, decision processes Mapping psychological insights onto digital traces Intro on KNIME / Orange

Settimana 2

Types of Data in Behavioural Analysis Structured (CRM, survey), unstructured (text, image), semi-structured Digital Footprints and Tracking Sources: clickstream, app usage, social media, sensors, eye-tracking

Settimana 3

What Is Multimodal Data? Definitions, challenges (synchronization, sparsity), relevance Hands on KNIME / Orange Integration Techniques Feature-level vs. decision-level fusion, entity resolution, schema alignment

Settimana 4

Text Mining in Marketing
 Preprocessing, keyword extraction, topic modeling Hands on KNIME / Orange Sentiment and Emotion Analysis Lexicon-based vs. ML-based sentiment classification in KNIME/Orange or Python

Settimana 5

Visual Content and Engagement: Computer vision basics: image tagging, feature extraction, branding cues Case Study: Instagram, Pinterest, YouTube: Analyzing campaign images and consumer response through visual features

Settimana 6

Behaviour Prediction with Machine Learning: Predicting churn, purchase, clicks using multimodal features Recommendation Systems for Behavioural Targeting: Collaborative filtering, hybrid models, explainability

Settimana 7

Customer Behavioural Clustering: Sequence mining, time-series patterns, path analysis Beyond RFM: From Descriptive to Predictive Clustering: Unsupervised learning with multimodal inputs

Settimana 8

A/B Testing and Behavioural Experiments: Test design, KPIs, interpretation pitfalls Uplift Modeling and Optimization: How to identify treatment-sensitive groups

Settimana 9

Designing Insightful Dashboards: Dashboard best practices, misleading visualizations, persuasion techniques Critiquing and Improving Visualizations: Student-led critique session on real-world dashboards

Settimana 10

Voice and Audio Cues in Behavioural Analytics: Emotion from tone, call center analysis, acoustic signal features Multimodal Emotion Recognition: Combining voice, facial expressions, and text (overview and demo)

Settimana 11

Ethics in Behavioural Data Use: Dark patterns, manipulative nudging, transparency, bias Legal Guidelines and Responsible AI: GDPR, AI Act, consent mechanisms, fairness in predictions

Settimana 12

Exam preparation: Practice oral exams, integration of concepts, Q&A