Graph news

Graph news

A node and another node loved each other, and made an edge...

Cold water for AI

Growth rate of key innovations

Growth rate of key innovations

You know what happens in cold water? Everything shrinks.

Bing's market share hasn't grown at all. Bing's share of search It's still stuck at a lousy 3%.

So did traffic to ChatGPT and other LLMs. What could be the possible reasons?

So, consumer demand is shrinking; with companies adopting the useful parts - the ones allowing them to run cheaper, extract more revenue - the usual. Remind something?

Hmmm…

Hmmm…

Yeah, too for me. Are there any ways forward/around/inside? I believe yeah, one possibility lying in reasoning.

Graph Machine Learning @ ICML 2023

Graphs + ML = ❤️

SE(3) Diffusion

SE(3) Diffusion

Some of the papers' topics:

  • New GNN architectures: novel ideas of dynamically rewired message passing with delay and slow nodes for long-range tasks

  • Generative Models: e.g. diffusion models for graph generation (think Stable Diffusion that makes graphs)

  • Molecules & proteins: generating molecules, protein description (by its structure), predicting high resolution mass spectra (in 19 min instead of 126 hours - x398 speedup)

  • Knowledge: knowledge graph embedding ('packing'), discovering both unseen entities and relations

Neurosymbolic AI recordings & excerpts

By Knowable Magazine

By Knowable Magazine

Day 1. Crash Course in Neuro-Symbolic AI (Aug 29, 2023)

Introduction

Intro to Practical Knowledge Representation and Logic + State-of-the-Art Practical Reasoning and Meta-Logic (hour 2)

Logic with probabilities

From Probabilistic Logics to Neurosymbolic AI

Reasoning with large language models

Robust Logic: Past, Present and Future

Compositional generalization

Panel

Day 2: Diverse Approaches at the Research Frontier of Neurosymbolic AI (Aug 30, 2023)

Some extensions and applications of Robust Logic

Deep Learning with Logical Requirements

Neuro-vector symbolic architectures

AI can learn from data. But can it learn to reason?

Thinking fast and slow in AI planning

Utilizing knowledge in compositional generalization

Causal abstraction for faithful, human-interpretable model explanations

Model-based ML: Towards causal reasoning in an AI Scientist

Panel

NSAI Toolkit

Source

Source

A huge repository of IBM-developed neurosymbolic AI OSS, divided into 8 categories:

  • Logical Neural Network (LNN)

  • Natural language processing via reasoning (NLP)

  • Knowledge foundation (KF)

  • Learning with less (LwL)

  • Knowledge augmented sequential decision making (SDM)

  • Human in the loop (HIL)

  • Datasets and environments (DS)

  • Related advances (RA)

Plus a nice taxonomy of neurosymbolic systems, which I won't include for brevity.


Welcome to Teleogenic/Boi Diaries❣️

Other places I cross-post to: