Today we are having a discussion with Letitia Parcalabescu from the AI Coffee Break youtube channel! We discuss linguistics, symbolic AI and our respective Youtube channels. Make sure you subscribe to her channel! In the first 15 minutes Tim dissects the recent article from Gary Marcus "Deep learning has hit a wall". Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB Pod: https://anchor.fm/machinelearningstreettalk/episodes/70---LETITIA-PARCALABESCU---Symbolics--Linguistics-UNPLUGGED-e1fuqas [00:00:00] Comments on Gary Marcus Article / Symbolic AI [00:14:57] Greetings [00:17:40] Introduction [00:18:48] A shared journey towards computation [00:22:10] A linguistics outsider [00:24:11] Is computational linguistics AI? [00:28:23] swinging pendulums of dogma and resource allocation [00:31:16] the road less travelled [00:34:35] pitching grants with multimodality ... and then the truth [00:40:50] some aspects of language are statistically learnable [00:44:58] ... and some aspects of language are dimensionally cursed [00:48:24] it's good to have both approaches to machine intelligence [00:51:14] the world runs on symbols [00:54:28] there is much more to learn biology [00:59:26] Letitia's creation process [01:02:23] don't overfit content, instead publish and iterate [01:07:48] merging the big picture arrow from the small direction arrows [01:11:02] use passion to drive through failure to success [01:12:56] stay positive [01:16:02] closing remarks AI Coffee Break with Letitia https://www.youtube.com/c/AICoffeeBreak https://twitter.com/AICoffeeBreak References; On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 [Bender et al] https://dl.acm.org/doi/10.1145/3442188.3445922 On the Measure of Intelligence [Chollet] https://arxiv.org/pdf/1911.01547.pdf Deep Learning Is Hitting a Wall [Marcus] https://nautil.us/deep-learning-is-hitting-a-wall-14467/ Intellectual issues in the history of artificial intelligence [Newell, 82] https://apps.dtic.mil/sti/pdfs/ADA125318.pdf Neurosymbolic AI: The 3rd Wave [Garcez, Lamb] https://arxiv.org/abs/2012.05876 Melanie Mitchell tweet https://twitter.com/MelMitchell1/status/1503513921650634759 Symbolic Behaviour in Artificial Intelligence [Santoro, Lampinen et al] https://arxiv.org/abs/2102.03406 The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence [Marcus] https://arxiv.org/abs/2002.06177