New Neural Network with 500 Billion Parameters
Google just published a research article about its Pathways Language Model (PaML), a neural network with 500 billion parameters. It is unclear to me how many layers and how many neurons (also called...
View ArticleAmazing Neural Network Video Demonstration
I recently posted an article featuring a very deep neural network in action (250 layers), see here. Each frame in the video represented one layer, with the signal propagating from one layer to the...
View ArticleNew Book: Efficient Deep Learning
Subtitled “Fast, smaller, and better models”. This book goes through algorithms and techniques used by researchers and engineers at Google Research, Facebook AI Research (FAIR), and other eminent AI...
View ArticleFast Classification and Clustering via Image Convolution Filters
Subtitled “Alternative to Generative Mixture Models”, the full version in PDF format is accessible in the “Free Books and Articles” section, here. It is also described in details in my book “Stochastic...
View ArticleNew Book: Intuitive Machine Learning and Explainable AI
Intuitive Machine Learning with focus on explainable AI, human-friendly intelligence, powerful visualizations and applications. By Vincent Granville Ph.D, published in September 2022. PDF format, 156...
View ArticleData Synthetization: enhanced GANs vs Copulas
Using case studies, I compare generative adversarial networks (GANs) with copulas to synthesize tabular data. I discuss back-end and front-end improvements to help GANs better replicate the correlation...
View ArticleMassively Speed-Up your Learning Algorithm, with Stochastic Thinning
You have to see it to believe it! Imagine a technique where you randomly delete as many as 80% of your observations in the training set, without decreasing the predictive power (actually improving it...
View ArticleNew Book: Understanding Deep Learning
By Simon Prince, computer science Professor at the University of Alberta. To be published by MIT Press, Dec 2023. The author shares the associated Jupyter notebooks on his website, here. Very popular,...
View ArticleNew Book: State of the Art in GenAI & LLMs — Creative Projects, with Solutions
With 23 top projects, 96 subprojects, and 6000 lines of Python code, this vendor-neutral coursebook is a goldmine for any analytic professional or AI/ML engineer interested in developing superior GenAI...
View ArticleSynthesizing Multi-Table Databases: Model Evaluation & Vendor Comparison
Synthesizing multi-table tabular data presents its own challenges, compared to single-table. When the database contains date columns such as transaction or admission date, a frequent occurrence in...
View Article