Whenever I see OpenAI's Sam Altman with his pseudo-innocent glance, he always reminds me of Carter Burke from Aliens (1986), who deceived the entire spaceship crew in favor of his corporation, with the aim of getting rich by weaponizing a newly discovered intelligent lifeform.

#AI#ArtificialIntelligence #aliens #alien#MachineLearning#ML#DeepLearning#LLM #LLMs#GenerativeAI#OpenAI#Microsoft

📣 We’re recruiting Volunteer TA Selection Committee Members

This role is ideal for academics, educators, and researchers who understand Python and who care deeply about teaching quality, mentorship, and equitable access to graduate-level computational education. If you are a previous NMA/CMA student or TA, we’d love to hear from you!

Applications close 15 Feb

➡️ Learn more and apply here: https://neuromatch.io/volunteer/

#ComputationalScience #Neuroscience #MachineLearning #DeepLearning #NeuroAI

I'm thinking back to 2021 when I was writing my thesis in university and had to read academic research papers every day.

The authors (all Israeli) of the deep learning papers I had to read in 2021, shared this in June 2024.

#genocide #palestine #cvpr #deeplearning #computervision

Thanks to everyone who came to our Academy Info Session!

Missed it?
➡️Watch the recording: https://youtu.be/Ja-4meM2dWc?si=8vg1RTF33DwBd1qO
➡️View the slides: https://drive.google.com/file/d/1j8OgocZPAbunNtaSz6M66Bcd-m2paj13/view?usp=sharing
➡️And be ready to apply 16 Feb-15 March! 💫

#CompNeuro #NeuroAI #DeepLearning #ClimateScience #SummerSchool

Thinking about joining us in July? Learn more about the Academy and ask questions in our live info sessions! Our last two are happening soon! 🎉 🤓

➡️Join us by registering here: https://neuromatch.io/neuromatch-and-climatematch-academy-info-session/

#CompNeuro #ClimateScience #NeuroAI #DeepLearning

In the Reverse Engineering world, we have a rule: You don't own it until you can take it apart.

The same applies to Artificial Intelligence.

We are currently drowning in API wrappers. Everyone is "building AI apps," but very few people are looking at the wiring underneath. To truly understand modern LLMs, I decided to stop using libraries. I went back to the drawing board to build a custom architecture from scratch.

Meet SARAN (Shallow Auto-Regressive Attention Network).

It’s not designed to beat GPT-4. It’s designed to be transparent. 🔹 I built a strict 15-stage computational graph. 🔹 I manually implemented backpropagation to trace the gradients. 🔹 I scaled it to a 354M parameter model to watch how it learns.

I’ve documented the entire build log—including the architecture decisions and the "why" behind the math—in my new engineering newsletter, Bits & Neurons.

If you want to move beyond the hype and understand the mechanics of AI, read the full breakdown here: https://mytechnotalent.substack.com

#ArtificialIntelligence #MachineLearning #DeepLearning #ReverseEngineering #Engineering #BuildInPublic

In the Reverse Engineering world, we have a rule: You don't own it until you can take it apart.

The same applies to Artificial Intelligence.

We are currently drowning in API wrappers. Everyone is "building AI apps," but very few people are looking at the wiring underneath. To truly understand modern LLMs, I decided to stop using libraries. I went back to the drawing board to build a custom architecture from scratch.

Meet SARAN (Shallow Auto-Regressive Attention Network).

It’s not designed to beat GPT-4. It’s designed to be transparent. 🔹 I built a strict 15-stage computational graph. 🔹 I manually implemented backpropagation to trace the gradients. 🔹 I scaled it to a 354M parameter model to watch how it learns.

I’ve documented the entire build log—including the architecture decisions and the "why" behind the math—in my new engineering newsletter, Bits & Neurons.

If you want to move beyond the hype and understand the mechanics of AI, read the full breakdown here: https://mytechnotalent.substack.com

#ArtificialIntelligence #MachineLearning #DeepLearning #ReverseEngineering #Engineering #BuildInPublic

Our first of four Academy Info sessions is happening soon! 🎉 🤓

Join us by registering here: https://neuromatch.io/neuromatch-and-climatematch-academy-info-session/

#CompNeuro #ClimateScience #NeuroAI #DeepLearning

Starting from scratch: Training a 30M Topological Transformer

https://www.tuned.org.uk/posts/013_the_topological_transformer_training_tauformer

#HackerNews #Starting #from #scratch: #Training #a #30M #Topological #Transformer

topologicaltransformer #training #machinelearning #AI #research #deeplearning

We are very excited that The Carpentries Lab lesson "Introduction to Deep Learning" has been accepted to the Journal of Open Source Education! 👏

The lesson is a practical introduction to deep learning, intended for researchers who are familiar with (non-deep) #MachineLearning. It addresses the need for an introductory lesson on #DeepLearning that is #OpenSource, and can be used by instructors in a workshop as well as for self-study. While generally usable, its target audience are academic researchers.

Find out more: https://jose.theoj.org/papers/10.21105/jose.00307

We are very excited that The Carpentries Lab lesson "Introduction to Deep Learning" has been accepted to the Journal of Open Source Education! 👏

The lesson is a practical introduction to deep learning, intended for researchers who are familiar with (non-deep) #MachineLearning. It addresses the need for an introductory lesson on #DeepLearning that is #OpenSource, and can be used by instructors in a workshop as well as for self-study. While generally usable, its target audience are academic researchers.

Find out more: https://jose.theoj.org/papers/10.21105/jose.00307

"animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics" recently published! http://doi.org/10.1111/2041-210x.70218 #bioacoustics #machinelistening #deeplearning

The Lottery Ticket Hypothesis: finding sparse trainable NNs with 90% less params

https://arxiv.org/abs/1803.03635

#HackerNews #LotteryTicketHypothesis #SparseNeuralNetworks #DeepLearning #AIResearch #ModelOptimization

"animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics" recently published! http://doi.org/10.1111/2041-210x.70218 #bioacoustics #machinelistening #deeplearning

Neural Networks: Zero to Hero

https://karpathy.ai/zero-to-hero.html

#HackerNews #Neural #Networks #Zero #to #Hero #AI #DeepLearning #MachineLearning #TechEducation

Recursive Language Models

https://arxiv.org/abs/2512.24601

#HackerNews #Recursive #Language #Models #AI #Research #MachineLearning #NaturalLanguageProcessing #DeepLearning

Ein Blog mit vier Beiträgen im Jahr, ist noch lange nicht tot! @spinfocl gibt in seinem legendären #Jahresrückblick Einblicke in sein Leben als Geschäftsführer und Wissenschaftler an einem Universitätsinstitut... Lektüre lohnt allein schon für die Public Humanities-Projekte seiner Studierender und natürlich, weil wir wissen wollen, wie es mit der Entschlüsselung des #Voynich-Manuskripts weitergeht!
Bitte hier entlang =>https://texperimentales.hypotheses.org/6146

#DH #Digital Humanities #Deeplearning

Ein Blog mit vier Beiträgen im Jahr, ist noch lange nicht tot! @spinfocl gibt in seinem legendären #Jahresrückblick Einblicke in sein Leben als Geschäftsführer und Wissenschaftler an einem Universitätsinstitut... Lektüre lohnt allein schon für die Public Humanities-Projekte seiner Studierender und natürlich, weil wir wissen wollen, wie es mit der Entschlüsselung des #Voynich-Manuskripts weitergeht!
Bitte hier entlang =>https://texperimentales.hypotheses.org/6146

#DH #Digital Humanities #Deeplearning