<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Researches | Pablo Piantanida</title><link>https://pablo-piantanida.org/research/</link><atom:link href="https://pablo-piantanida.org/research/index.xml" rel="self" type="application/rss+xml"/><description>Researches</description><generator>Wowchemy (https://wowchemy.com)</generator><image><url>https://pablo-piantanida.org/media/icon_hua1fbb9c9e9f2b3de37453509d7d6635c_26816_512x512_fill_lanczos_center_3.png</url><title>Researches</title><link>https://pablo-piantanida.org/research/</link></image><item><title>Collaborative &amp; Resource-Aware Agentic Intelligence</title><link>https://pablo-piantanida.org/research/collaboration/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://pablo-piantanida.org/research/collaboration/</guid><description>&lt;div class="pp-topic-intro">
&lt;p>My research investigates how agents with different information can communicate and cooperate. It connects information-theoretic foundations of distributed inference with pragmatic models of retrieval and dialogue.&lt;/p>
&lt;p>A central theme is that communication should be understood through its contribution to a shared task: what an agent communicates, what another agent can infer, and how the exchange changes subsequent decisions.&lt;/p>
&lt;/div>
&lt;section class="pp-topic-questions" aria-labelledby="key-questions">
&lt;h2 id="key-questions">Key questions&lt;/h2>
&lt;ul>
&lt;li>What information should agents exchange to solve a shared task?&lt;/li>
&lt;li>How can communication account for another agent’s knowledge and beliefs?&lt;/li>
&lt;li>What are the benefits and limits of interaction under communication constraints?&lt;/li>
&lt;/ul>
&lt;/section>
&lt;section aria-labelledby="selected-contributions">
&lt;h2 id="selected-contributions">Selected contributions&lt;/h2>
&lt;div class="pp-topic-papers">
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">EMNLP · 2025&lt;/p>
&lt;h3>&lt;a href="https://pablo-piantanida.org/papers/collaborative-rsa/">Collaborative Rational Speech Act: Pragmatic Reasoning for Multi-Turn Dialog&lt;/a>&lt;/h3>
&lt;p>Studying collaborative dialogue between agents with private information.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://aclanthology.org/2025.emnlp-main.1145/">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2507.14063">arXiv ↗&lt;/a>
&lt;a href="https://github.com/LautaroEst/crsa">Code ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">SIGIR · 2025&lt;/p>
&lt;h3>&lt;a href="https://doi.org/10.1145/3726302.3730239">Rational Retrieval Acts: Leveraging Pragmatic Reasoning to Improve Sparse Retrieval&lt;/a>&lt;/h3>
&lt;p>Applying pragmatic reasoning to the information conveyed by retrieval terms.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://doi.org/10.1145/3726302.3730239">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2505.03676">arXiv ↗&lt;/a>
&lt;a href="https://github.com/arthur-75/Rational-Retrieval-Acts">Code ↗&lt;/a>
&lt;a href="https://github.com/arthur-75/Rational-Retrieval-Acts/blob/main/poster_SIGIR.svg">Poster ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">IEEE Transactions on Information Theory · 2019&lt;/p>
&lt;h3>&lt;a href="https://doi.org/10.1109/TIT.2018.2883295">Collaborative Information Bottleneck&lt;/a>&lt;/h3>
&lt;p>Studying trade-offs between communication complexity and relevant information in a cooperative setting.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://doi.org/10.1109/TIT.2018.2883295">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/1604.01433">arXiv ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">IEEE Transactions on Information Theory · 2017&lt;/p>
&lt;h3>&lt;a href="https://doi.org/10.1109/TIT.2016.2621749">The Three-Terminal Interactive Lossy Source Coding Problem&lt;/a>&lt;/h3>
&lt;p>Investigating fundamental limits of interactive communication for reconstructing distributed sources.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://doi.org/10.1109/TIT.2016.2621749">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/1502.01359">arXiv ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;/div>
&lt;/section>
&lt;section class="pp-topic-ongoing">&lt;h2>Ongoing research&lt;/h2>
&lt;p>Building on these contributions, I am interested in how collaborative systems should allocate information, computation, and communication to support reliable decisions under limited resources.&lt;/p>
&lt;/section>
&lt;nav class="pp-topic-explore" aria-label="Explore related research">
&lt;h2>Explore further&lt;/h2>
&lt;ul>
&lt;li>&lt;a href="https://pablo-piantanida.org/publications/">Full publication list →&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://pablo-piantanida.org/research/foundations/">Mathematical Foundations of Learning, Representation &amp;amp; Reasoning →&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://pablo-piantanida.org/research/reliability/">Uncertainty, Evaluation &amp;amp; Reliable Decision-Making →&lt;/a>&lt;/li>
&lt;/ul>
&lt;/nav></description></item><item><title>Mathematical Foundations of Learning, Representation &amp; Reasoning</title><link>https://pablo-piantanida.org/research/foundations/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://pablo-piantanida.org/research/foundations/</guid><description>&lt;div class="pp-topic-intro">
&lt;p>My research investigates the mathematical principles underlying learning and representation. Drawing on information theory and statistical decision theory, I study how representations retain task-relevant information, how their usefulness can be compared, and how knowledge can be transferred across models.&lt;/p>
&lt;p>The objective is to connect the design of learning systems with precise questions about information, sufficiency, and downstream decisions.&lt;/p>
&lt;/div>
&lt;section class="pp-topic-questions" aria-labelledby="key-questions">
&lt;h2 id="key-questions">Key questions&lt;/h2>
&lt;ul>
&lt;li>What makes one representation more useful than another?&lt;/li>
&lt;li>How can information-theoretic principles guide learning objectives?&lt;/li>
&lt;li>How can multiple models contribute to reusable representations?&lt;/li>
&lt;/ul>
&lt;/section>
&lt;section aria-labelledby="selected-contributions">
&lt;h2 id="selected-contributions">Selected contributions&lt;/h2>
&lt;div class="pp-topic-papers">
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">NeurIPS · 2024&lt;/p>
&lt;h3>&lt;a href="https://pablo-piantanida.org/papers/embedding-comparison/">When Is an Embedding Model More Promising Than Another?&lt;/a>&lt;/h3>
&lt;p>Comparing representations through their potential usefulness across downstream tasks.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://proceedings.neurips.cc/paper_files/paper/2024/hash/7e6f445a74cdb71931aac64f1e3f49c9-Abstract-Conference.html">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2406.07640">arXiv ↗&lt;/a>
&lt;a href="https://github.com/ills-montreal/emir">Code ↗&lt;/a>
&lt;a href="https://neurips.cc/virtual/2024/poster/94873">Poster &amp; presentation ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">NeurIPS · 2025&lt;/p>
&lt;h3>&lt;a href="https://proceedings.neurips.cc/paper_files/paper/2025/file/9e11d680214e92c1683aaf80ae30febe-Paper-Conference.pdf">Learning Task-Agnostic Representations through Multi-Teacher Distillation&lt;/a>&lt;/h3>
&lt;p>Investigating how knowledge from multiple teachers can support representations that remain useful across tasks.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://proceedings.neurips.cc/paper_files/paper/2025/file/9e11d680214e92c1683aaf80ae30febe-Paper-Conference.pdf">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2510.18680">arXiv ↗&lt;/a>
&lt;a href="https://github.com/ills-montreal/nlp-distill">Code: NLP ↗&lt;/a>
&lt;a href="https://github.com/ills-montreal/mol-distill">Code: molecules ↗&lt;/a>
&lt;a href="https://github.com/ills-montreal/vision-distill/">Code: vision ↗&lt;/a>
&lt;a href="https://neurips.cc/virtual/2025/loc/san-diego/poster/115301">Poster &amp; presentation ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">Machine Learning · 2023&lt;/p>
&lt;h3>&lt;a href="https://doi.org/10.1007/s10994-023-06337-6">The Role of Mutual Information in Variational Classifiers&lt;/a>&lt;/h3>
&lt;p>Examining the role of mutual information in classification objectives and learned predictive representations.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://doi.org/10.1007/s10994-023-06337-6">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2010.11642">arXiv ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">ICML · 2022&lt;/p>
&lt;h3>&lt;a href="https://proceedings.mlr.press/v162/pichler22a.html">A Differential Entropy Estimator for Training Neural Networks&lt;/a>&lt;/h3>
&lt;p>Connecting continuous information measures with objectives used to train neural networks.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://proceedings.mlr.press/v162/pichler22a.html">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2202.06618">arXiv ↗&lt;/a>
&lt;a href="https://github.com/g-pichler/knife">Code ↗&lt;/a>
&lt;a href="https://icml.cc/media/PosterPDFs/ICML%202022/2d36b5821f8affc6868b59dfc9af6c9f.png?t=1657471992.0265052">Poster ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;/div>
&lt;/section>
&lt;nav class="pp-topic-explore" aria-label="Explore related research">
&lt;h2>Explore further&lt;/h2>
&lt;ul>
&lt;li>&lt;a href="https://pablo-piantanida.org/publications/">Full publication list →&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://pablo-piantanida.org/research/reliability/">Uncertainty, Evaluation &amp;amp; Reliable Decision-Making →&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://pablo-piantanida.org/research/collaboration/">Collaborative &amp;amp; Resource-Aware Agentic Intelligence →&lt;/a>&lt;/li>
&lt;/ul>
&lt;/nav></description></item><item><title>Uncertainty, Evaluation &amp; Reliable Decision-Making</title><link>https://pablo-piantanida.org/research/reliability/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://pablo-piantanida.org/research/reliability/</guid><description>&lt;div class="pp-topic-intro">
&lt;p>My research studies how intelligent systems can recognize uncertainty, identify potential failures, and support decisions about when to act, reject a prediction, or seek additional evidence.&lt;/p>
&lt;p>This work connects statistical measures of uncertainty with practical evaluation methods. It spans classification and regression, generated-content assessment, and the privacy risks associated with trained models.&lt;/p>
&lt;p>Our work on prediction errors leads to a practical question for auditors: what evidence should they collect next under a limited testing budget? Our &lt;a href="https://hal.science/hal-05498201v1">position paper on language-model auditing&lt;/a> examines this question in changing deployment contexts.&lt;/p>
&lt;/div>
&lt;section class="pp-topic-questions" aria-labelledby="key-questions">
&lt;h2 id="key-questions">Key questions&lt;/h2>
&lt;ul>
&lt;li>Can a model appear confident while being wrong?&lt;/li>
&lt;li>Which uncertainty measures help identify unreliable predictions?&lt;/li>
&lt;li>How should we evaluate generated content and information leakage?&lt;/li>
&lt;/ul>
&lt;/section>
&lt;section aria-labelledby="selected-contributions">
&lt;h2 id="selected-contributions">Selected contributions&lt;/h2>
&lt;div class="pp-topic-papers">
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">NeurIPS · 2021&lt;/p>
&lt;h3>&lt;a href="https://pablo-piantanida.org/papers/doctor/">DOCTOR: A Simple Method for Detecting Misclassification Errors&lt;/a>&lt;/h3>
&lt;p>Identifying potentially incorrect classifier predictions from the probabilities produced by a trained model.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://pablo-piantanida.org/papers/doctor/">Paper overview →&lt;/a>
&lt;a href="https://proceedings.neurips.cc/paper/2021/hash/2cb6b10338a7fc4117a80da24b582060-Abstract.html">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2106.02395">arXiv ↗&lt;/a>
&lt;a href="https://github.com/fgranese/DOCTOR">Code ↗&lt;/a>
&lt;a href="https://neurips.cc/media/neurips-2021/Slides/28016.pdf">Slides ↗&lt;/a>
&lt;a href="https://neurips.cc/virtual/2021/poster/28016">Presentation ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">ICLR · 2024&lt;/p>
&lt;h3>&lt;a href="https://pablo-piantanida.org/papers/relative-uncertainty/">A Data-Driven Measure of Relative Uncertainty for Misclassification Detection&lt;/a>&lt;/h3>
&lt;p>Learning uncertainty measures that can distinguish errors even when conventional confidence measures are misleading.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://pablo-piantanida.org/papers/relative-uncertainty/">Paper overview →&lt;/a>
&lt;a href="https://proceedings.iclr.cc/paper_files/paper/2024/file/5e0da5da69b71349ae0bd7ad716e4bc9-Paper-Conference.pdf">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2306.01710">arXiv ↗&lt;/a>
&lt;a href="https://github.com/edadaltocg/relative-uncertainty">Code ↗&lt;/a>
&lt;a href="https://github.com/edadaltocg/relative-uncertainty/releases/tag/checkpoints">Model checkpoints ↗&lt;/a>
&lt;a href="https://iclr.cc/virtual/2024/poster/17676">Poster &amp; presentation ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">ICML · 2024&lt;/p>
&lt;h3>&lt;a href="https://icml.cc/virtual/2024/poster/33759">Beyond the Norms: Detecting Prediction Errors in Regression Models&lt;/a>&lt;/h3>
&lt;p>Extending the study of prediction reliability to regression.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://icml.cc/virtual/2024/poster/33759">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2406.06968">arXiv ↗&lt;/a>
&lt;a href="https://zenodo.org/records/11281964">Archived code ↗&lt;/a>
&lt;a href="https://icml.cc/media/PosterPDFs/ICML%202024/33759.png?t=1721579758.0505557">Poster ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">ACL · 2024&lt;/p>
&lt;h3>&lt;a href="https://aclanthology.org/2024.acl-long.686/">COSMIC: Mutual Information for Task-Agnostic Summarization Evaluation&lt;/a>&lt;/h3>
&lt;p>Using an information-theoretic perspective to assess summaries across potential downstream uses.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://aclanthology.org/2024.acl-long.686/">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2402.19457">arXiv ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;article class="pp-topic-paper">
&lt;p class="pp-topic-venue">JMLR · 2025&lt;/p>
&lt;h3>&lt;a href="https://pablo-piantanida.org/papers/membership-inference-limits/">Fundamental Limits of Membership Inference Attacks on Machine Learning Models&lt;/a>&lt;/h3>
&lt;p>Characterizing statistical limits on attempts to infer whether a data point was used in training.&lt;/p>
&lt;div class="pp-topic-paper-links">
&lt;a href="https://pablo-piantanida.org/papers/membership-inference-limits/">Paper overview →&lt;/a>
&lt;a href="https://www.jmlr.org/papers/v26/24-1515.html">Paper ↗&lt;/a>
&lt;a href="https://arxiv.org/abs/2310.13786">arXiv ↗&lt;/a>
&lt;/div>
&lt;/article>
&lt;/div>
&lt;/section>
&lt;nav class="pp-topic-explore" aria-label="Explore related research">
&lt;h2>Explore further&lt;/h2>
&lt;ul>
&lt;li>&lt;a href="https://pablo-piantanida.org/publications/">Full publication list →&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://github.com/edadaltocg/relative-uncertainty">Relative Uncertainty implementation ↗&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://pablo-piantanida.org/research/foundations/">Mathematical Foundations of Learning, Representation &amp;amp; Reasoning →&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://pablo-piantanida.org/research/collaboration/">Collaborative &amp;amp; Resource-Aware Agentic Intelligence →&lt;/a>&lt;/li>
&lt;/ul>
&lt;/nav></description></item></channel></rss>