Generating Diverse High-Fidelity Images with VQ-VAE-2
Razavi et al.: https://arxiv.org/abs/1906.00446
#ArtificialIntelligence #DeepLearning #MachineLearning

A parallel implementation of "graph2vec: Learning Distributed Representations of Graphs" (MLGWorkshop 2017).

https://github.com/benedekrozemberczki/graph2vec

A Survival Guide to a PhD
https://karpathy.github.io/2016/09/07/phd/ https://t.iss.one/ArtificialIntelligenceArticles

Cross-lingual transfer is a powerful tool for low-resource NLP. But when you build a system for a new language (say Bengali, German or French), what language do you transfer from?

This paper answers this: https://www.profillic.com/paper/arxiv:1905.12688

PyFastBertTorch

https://medium.com/huggingface/introducing-fastbert-a-simple-deep-learning-library-for-bert-models-89ff763ad384

COBRA: Data-Efficient Model-Based RL through Unsupervised Object Discovery and Curiosity-Driven Exploration
Watters et al.: https://arxiv.org/abs/1905.09275
#MachineLearning #UnsupervisedLearning #ArtificialIntelligence

A very nice article on practical limitations of semi-supervised learning and the recent advances that seems to overcome them
[https://towardsdatascience.com/the-quiet-semi-supervised-revolution-edec1e9ad8c]


(https://towardsdatascience.com/the-quiet-semi-supervised-revolution-edec1e9ad8c)


#machinelearning #artificialintelligence

Table2Vec: Neural Word and Entity Embeddings for Table Population and Retrieval. arxiv.org/abs/1906.00041

Independent Component Analysis based on multiple data-weighting. arxiv.org/abs/1906.00028

Machine Learning Methods for Shark Detection. arxiv.org/abs/1905.13309

Brain Network Mechanisms of General Intelligence

https://www.biorxiv.org/content/biorxiv/early/2019/06/03/657205.full.pdf

Revolutionizing Medical Diagnosis with Deep Learning: TED Talk

https://www.youtube.com/watch?v=w2_N_p_Y-W4&feature=youtu.be

Understanding and Controlling Memory in Recurrent Neural Networks (ICML'19 oral)

This paper shows that RNNs are able to form long-term memories despite being trained only for short-term with a limited amount of timesteps, but that not all memories are created equal. The authors find that each memory is correlated with a dynamical object in the hidden-state phase space and that the objects properties can quantitatively predict long term effectiveness. By regularizing the dynamical object, the long-term functionality of the RNN is significantly improved, while not adding to the computational complexity of training.

Link to PDF: https://proceedings.mlr.press/v97/haviv19a/haviv19a.pdf

Study shows that artificial neural networks can be used to drive brain activity.



MIT neuroscientists have performed the most rigorous testing yet of computational models that mimic the brain’s visual cortex.

Using their current best model of the brain’s visual neural network, the researchers designed a new way to precisely control individual neurons and populations of neurons in the middle of that network. In an animal study, the team then showed that the information gained from the computational model enabled them to create images that strongly activated specific brain neurons of their choosing.

The findings suggest that the current versions of these models are similar enough to the brain that they could be used to control brain states in animals. The study also helps to establish the usefulness of these vision models, which have generated vigorous debate over whether they accurately mimic how the visual cortex works, says James DiCarlo, the head of MIT’s Department of Brain and Cognitive Sciences, an investigator in the McGovern Institute for Brain Research and the Center for Brains, Minds, and Machines, and the senior author of the study.



Full article: https://news.mit.edu/2019/computer-model-brain-visual-cortex-0502

Science paper: https://science.sciencemag.org/content/364/6439/eaav9436

Biorxiv (open access): https://www.biorxiv.org/content/10.1101/461525v1

Andrew Ng and Masoumeh Haghpanahi the team's new paper -- Cardiologist-level arrhythmia detection from ECG using deep learning.

https://www.nature.com/articles/s41591-018-0268-3


https://stanfordmlgroup.github.io/projects/ecg2/

https://t.iss.one/ArtificialIntelligenceArticles

#DeepLearning #MachineLearning #artificalintelligence

@ArtificialIntelligenceArticles

Introducing FastBert — A simple Deep Learning library for BERT Models
Blog by Kaushal Trivedi: https://medium.com/huggingface/introducing-fastbert-a-simple-deep-learning-library-for-bert-models-89ff763ad384
#MachineLearning #ArtificialIntelligence #NLP #Bert #NaturalLanguageProcessing

A curated list of gradient boosting research papers from the last 25 years with implementations. It covers NeurIPS, ICML, ICLR, KDD, ICDM, CIKM, AAAI etc.
https://github.com/benedekrozemberczki/awesome-gradient-boosting-papers

Very interesting work applying machine learning to higher order logics and theorem proofs. This could eventually change how we understand and program many different things.

https://arxiv.org/abs/1904.03241

DeepMind Made a Math Test For Neural Networks
https://arxiv.org/abs/1904.01557

Should AI Research Try to Model the Human Brain?


https://www.cell.com/trends/cognitive-sciences/fulltext/S1364-6613(19)30061-0

17 equations that changed the world