Monday, March 24, 2025

Asian Immune Diversity Atlas (AIDA) CZI Cell Science

 https://cellxgene.cziscience.com/collections/ced320a1-29f3-47c1-a735-513c7084d508

Asian Immune Diversity Atlas (AIDA)

CZI Cell Science

The relationships of human diversity with biomedical phenotypes are pervasive, yet remain understudied, particularly in a single-cell genomics context. Here we present the Asian Immune Diversity Atlas (AIDA), a multi-national single-cell RNA-sequencing (scRNA-seq) healthy reference atlas of human immune cells. AIDA comprises 1,265,624 circulating immune cells from 619 donors, spanning 7 population groups across 5 Asian countries, and 6 controls. Though population groups are frequently compared at the continental level, we found that sub-continental diversity, age, and sex pervasively impacted cellular and molecular properties of immune cells. These included differential abundance of cell neighbourhoods, as well as cell populations and genes relevant to disease risk, pathogenesis, and diagnostics. We discovered functional genetic variants influencing cell type-specific gene expression which were under-represented in non-Asian populations, and helped contextualise disease-associated variants. AIDA enables analyses of multi-ancestry disease datasets and facilitates the development of precision medicine efforts in Asia and beyond. Please note that the AIDA Phase 1 Data Freeze v1 object comprises 1,058,909 peripheral blood mononuclear cells from 503 healthy donors from Japan, Singapore, and South Korea alongside common controls. This first AIDA data freeze was released to the research community pre-publication, and was also part of the first CZ CELLxGENE Census assembled in May 2023. Going from Data Freeze v1 to Data Freeze v2, we added additional healthy Asian donor samples and control samples - please see our publications for further details.

Group fairness in AI

 Group fairness in AI refers to ensuring that machine learning models treat different demographic groups equitably by achieving parity in statistical measures across groups defined by sensitive attributes like race, gender, or age. This approach evaluates fairness at the population level rather than the individual level16.

Key Principles

  • Protected Groups: Groups are defined by sensitive features (e.g., race, gender), which may or may not have privacy implications16.

  • Statistical Parity: Requires outcomes to be independent of sensitive attributes. For example, demographic parity mandates equal acceptance rates for job applicants across groups237.

  • Equality of Metrics: Common fairness metrics include:

    MetricDefinition
    Equalized OddsEqual true positive and false positive rates across groups47
    Equality of OpportunityEqual true positive rates across groups7
    Predictive ParitySimilar precision (positive predictive value) for all groups7

Implementation Challenges

  • Trade-offs with Individual Fairness: Group fairness may conflict with individual merit. For instance, enforcing demographic parity in hiring could prioritize underrepresented candidates over more qualified ones to meet statistical targets23.

  • Defining Sensitive Features: While some attributes (e.g., race) are obvious, others (e.g., language proficiency) require context-specific analysis16.

  • Mathematical Constraints: Fairness is often framed as parity in expectations over the distribution of data, such as P(Y^=1∣A=a)=P(Y^=1∣A=b)P(\hat{Y}=1 \mid A=a) = P(\hat{Y}=1 \mid A=b) for demographic parity, where Y^\hat{Y} is the prediction and AA is the sensitive attribute56.

Evaluation

  • Confusion Matrix Analysis: Metrics like recall, precision, and accuracy are compared across subgroups4.

  • Toolkits: Frameworks like Fairlearn and AI Fairness 360 operationalize group fairness through parity constraints, enabling developers to audit and mitigate biases16.

While group fairness is widely adopted, it has limitations—it cannot address individual-level disparities and may require balancing trade-offs with model accuracy235.

Citations:

  1. https://edwinwenink.github.io/ai-ethics-tool-landscape/fairness/group-fairness/
  2. https://www.lumenova.ai/blog/group-fairness-vs-individual-fairness/
  3. https://fairnessmeasures.github.io/Pages/Definitions
  4. https://knowledge.dataiku.com/latest/ml-analytics/responsible-ai/concept-group-fairness.html
  5. https://en.wikipedia.org/wiki/Fairness_(machine_learning)
  6. https://fairlearn.org/v0.5.0/user_guide/fairness_in_machine_learning.html
  7. https://www.brookings.edu/articles/fairness-in-machine-learning-regulation-or-standards/
  8. https://haas.berkeley.edu/wp-content/uploads/What-is-fairness_-EGAL2.pdf

Answer from Perplexity: pplx.ai/share

Sunday, March 23, 2025

Human Brain scRNA-seq Data related to AD and cognitive decline

 

Human Brain scRNA-seq Data related to AD and cognitive decline 

  1. Aging/AD Cortical Cell Atlas

    • Profiles 24 human frontal cortex samples with clinicopathologic traits (including cognitive decline metrics) using single-nucleus RNA-seq12.

    • Identified cell subtypes (e.g., SST+ inhibitory neurons, oligodendroglial states) and multicellular communities altered in Alzheimer’s disease (AD). Associations with tau pathology and cognitive decline were statistically validated12.

  2. SCAD-Brain Database

    • Aggregates 17 AD/mild cognitive impairment (MCI) projects from public repositories (GEO, Synapse):

      • 21 datasets | 359 samples | 10 brain regions | 1.56 million cells36.

      • Supports analysis of cell communication, trajectory, and differential gene expression in AD/MCI vs. controls36.

    • Access: SCAD-Brain.

TauAge

TauAge model and its significance in understanding regional tau pathology in aging, Alzheimer's disease (AD), and Primary Age-Related Tauopathy (PART):


🧬 What is TauAge?

TauAge is a DNA methylation (DNAm)-based epigenetic "clock" created by the authors to estimate the severity of phosphorylated tau (p-tau) pathology in specific brain regions.

Unlike traditional epigenetic clocks (e.g., Horvath clock) that estimate biological age, TauAge is trained to predict the pathological burden of p-tau, adjusted for chronological age. It provides a molecular readout of tau accumulation independent of aging.


⚙️ How TauAge Was Built

  1. Input Data:

    • DNA methylation profiles (DNAm) from the frontal cortex (Illumina arrays).
    • Corresponding histological quantification of p-tau in either the hippocampus or frontal cortex (depending on model).
    • Two cohorts: PWG (PART-only) and ROSMAP (AD and PART).
  2. Modeling Approach:

    • The authors used elastic net regression (a regularized machine learning model) to predict age-adjusted residuals of p-tau.
    • This means they removed the effect of chronological age to focus on DNAm markers that predict tau pathology beyond what you'd expect for someone’s age.
  3. Output:

    • A TauAge score per sample, reflecting how much tau burden is present in a region (hippocampus or frontal cortex), based purely on DNAm.
    • Each model uses hundreds of CpG sites as features.

🧠 Why Separate Models for Hippocampus and Frontal Cortex?

  • Tau pathology originates in the hippocampus (early) and spreads to the frontal cortex (later) in AD.
  • PART, by contrast, typically remains confined to the hippocampus and does not spread to cortex.

Thus, the biology driving p-tau accumulation is likely region-specific. The authors found:

  • Only 8 CpGs overlapped between the hippocampal and frontal TauAge models.
  • The models were not interchangeable — e.g., using hippocampal CpGs to predict frontal tau gave poor results.

➡️ Conclusion: p-tau pathology is regulated by distinct molecular programs in different brain regions.


🧠 What Does TauAge Reveal About AD vs. PART?

1. Hippocampal TauAge (PART & AD)

  • Biological associations:

    • Genes linked to TauAge CpGs are enriched in:
      • Synaptic transmission
      • Ion transport
      • Mitochondrial function
    • These functions are shared in both PART and AD.
  • Interpretation:

    • Tau accumulation in the hippocampus is driven by synaptic dysfunction, regardless of whether it's PART or AD.
    • Suggests that PART and early AD may share early tau-related vulnerability via similar epigenetic pathways.

2. Frontal Cortex TauAge (Only in AD)

  • Biological associations:

    • CpG-correlated genes are enriched in:
      • Inflammatory signaling
      • Cytokine production
      • Immune cell recruitment (e.g., T-cells, macrophages)
  • Interpretation:

    • Tau pathology in the frontal cortex (seen in later AD) is associated with inflammation, which is absent in PART.
    • This provides molecular evidence that neuroinflammation is a distinguishing feature of AD, not PART.

🧪 Validation and Predictive Power

  • TauAge outperformed traditional clocks like the Horvath pan-tissue clock or the brain-specific Cortical clock in predicting tau burden.
  • It accurately tracked regional pathology and even distinguished:
    • Mild Cognitive Impairment (MCI) vs. Dementia.
    • Cognitive resilience in Predicted-PART vs. Predicted-AD groups.

💡 Why TauAge Matters

  1. Region-specific insight: First model to quantify tau pathology in specific brain areas using methylation.
  2. Separates aging from disease: Measures pathology beyond what’s expected from age alone.
  3. Molecular divergence of PART vs. AD: Synaptic dysfunction is shared; inflammation is unique to AD.
  4. Biomarker potential: Could be developed into a diagnostic or risk-stratifying tool, especially if adapted to blood or CSF methylation data.
  5. Framework for further modeling: Could be extended with scRNA-seq, single-cell methylomics, or used in AI-based diagnostic pipelines.

Would you like a visual summary or help implementing a TauAge-like model on your own data?

Saturday, March 22, 2025

attack strategies targeting reward functions in reinforcement learning (RL) AI models,

 To systematically explore attack strategies targeting reward functions in reinforcement learning (RL) AI models, the following research strategy integrates theoretical analysis, empirical validation, and mitigation development:

1. Problem Definition & Vulnerability Analysis

  • Objective: Identify how reward function design influences exploitability.

  • Approach:

    • Classify reward functions by type (extrinsic/intrinsic/shaped1), structure (sparse/dense17), and optimization goals (cost minimization vs. reward maximization1).

    • Analyze attack surfaces:

      • Reward hacking: Exploiting unintended loopholes (e.g., infinite reward loops4).

      • Reward poisoning: Manipulating training data or reward signals to induce malicious policies56.

    • Prioritize vulnerabilities in adaptive vs. non-adaptive attacks, noting that adaptive methods can achieve goals faster6.

2. Attack Methodology Development

  • Objective: Design and benchmark attack vectors.

  • Approach:

    • Poisoning Attacks:

      • Training-time: Inject adversarial perturbations into reward signals (e.g., δₜ in rt + δₜ6).

      • Preference-based: Manipulate human feedback datasets (e.g., label-flipping in RLHF5).

    • Exploratory Attacks:

      • Test reward-shaping vulnerabilities (e.g., sparse reward exploitation7).

      • Develop adaptive attacks leveraging agent policy updates during training6.

    • Metrics: Measure attack success via policy divergence, time-to-compromise, and stealthiness (e.g., detectability of manipulated rewards5).

3. Empirical Validation

  • Objective: Evaluate attacks across RL environments.

  • Testbeds:

    • Simulations: Gridworlds, MuJoCo, Atari games.

    • Real-world tasks: Autonomous navigation, recommendation systems.

  • Variables:

    • Compare attack efficacy under different reward structures (e.g., dense vs. sparse17).

    • Test robustness of model-based vs. model-free RL algorithms.

4. Impact Analysis

  • Objective: Quantify consequences of compromised reward functions.

  • Key Questions:

    • How do poisoned rewards degrade policy performance or safety?

    • Can attacks induce catastrophic forgetting or goal hijacking?

    • What is the minimum perturbation (δₜ) required for successful attacks6?

5. Defense Mechanisms

  • Objective: Propose countermeasures.

  • Strategies:

    • Robust Reward Design:

      • Uncertainty-aware reward inference (e.g., MURAL7).

      • Constrained optimization to limit reward manipulation3.

    • Detection Systems:

      • Anomaly detection in reward distributions.

      • Adversarial training with perturbed rewards6.

    • Formal Guarantees: Certify safety thresholds for reward perturbations6.

6. Ethical & Practical Considerations

  • Objective: Ensure responsible research practices.

  • Guidelines:

    • Restrict testing to controlled environments.

    • Collaborate with AI safety communities to preempt real-world misuse.

    • Disclose vulnerabilities to affected frameworks (e.g., OpenAI, DeepMind).

Implementation Timeline

PhaseDurationDeliverables
1–26 monthsTaxonomy of vulnerabilities; attack prototypes
3–49 monthsBenchmark results; impact analysis framework
5–612 monthsDefense toolkit; ethical guidelines

This strategy balances offensive exploration (to identify risks) and defensive innovation (to mitigate harms), advancing both RL security and robustness.

Citations:

  1. https://www.linkedin.com/pulse/rewards-reinforcement-learning-caleb-m-bowyer
  2. https://spinningup.openai.com/en/latest/spinningup/rl_intro.html
  3. https://proceedings.neurips.cc/paper_files/paper/2021/file/a7f0d2b95c60161b3f3c82f764b1d1c9-Paper.pdf
  4. https://rodtrent.substack.com/p/must-learn-ai-security-part-12-reward
  5. https://aclanthology.org/2024.acl-long.140.pdf
  6. https://par.nsf.gov/servlets/purl/10183713
  7. http://bair.berkeley.edu/blog/2021/10/22/mural/
  8. https://learnprompting.org/blog/openai-solution-reward-hacking
  9. https://jair.org/index.php/jair/article/view/12440
  10. https://openreview.net/forum?id=25G63lDHV2
  11. https://isaacperper.com/images/6881_intrinsic/6_881_Final_Report.pdf
  12. https://www.alignmentforum.org/posts/Ge55vxEmKXunFFwoe/reward-hacking-behavior-can-generalize-across-tasks
  13. https://par.nsf.gov/servlets/purl/10183709
  14. https://alignment.anthropic.com/2025/reward-hacking-ooc/
  15. https://lilianweng.github.io/posts/2024-11-28-reward-hacking/
  16. https://www.reddit.com/r/reinforcementlearning/comments/1ae9t90/how_does_reward_work_while_training_a/
  17. https://arxiv.org/abs/2205.15400
  18. https://en.wikipedia.org/wiki/Reinforcement_learning
  19. https://www.reddit.com/r/reinforcementlearning/comments/vicory/does_the_value_of_the_reward_matter/
  20. https://ojs.aaai.org/index.php/AAAI/article/view/26240/26012
  21. https://arxiv.org/pdf/2102.08492.pdf
  22. https://www.semanticscholar.org/paper/Reward-Machines:-Exploiting-Reward-Function-in-Icarte-Klassen/6778d6a0f959cdcc42718ee9fc279fd1f00f3d88
  23. https://www.sciencedirect.com/science/article/abs/pii/S0925231223007014
  24. https://arxiv.org/abs/2211.09019
  25. https://arxiv.org/html/2402.09695v1
  26. https://stackoverflow.com/questions/47133913/what-is-importance-of-reward-policy-in-reinforcement-learninig
  27. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/136931/guoxiao_1.pdf
  28. https://stats.stackexchange.com/questions/189067/how-to-make-a-reward-function-in-reinforcement-learning
  29. https://ai.stackexchange.com/questions/22851/what-are-some-best-practices-when-trying-to-design-a-reward-function
  30. https://www.reddit.com/r/reinforcementlearning/comments/12jey74/exploiting_the_model_in_reinforcement_learning/
  31. https://github.com/RodrigoToroIcarte/reward_machines
  32. https://www.jair.org/index.php/jair/article/download/12440/26759/29354

Answer from Perplexity: pplx.ai/share