The popularity of machine learning is so great that people try to use it wherever they can. Some attempts to replace classical approaches with neural networks turn up unsuccessful. This time we'll consider machine learning in terms of creating effective static code analyzers for finding bugs and potential vulnerabilities.

The PVS-Studio team believes that with machine learning, there are many pitfalls lurking in code analysis tasks.

https://bit.ly/2vqmeV7

Learning to See Transparent Objects

ClearGrasp uses 3 neural networks: a network to estimate surface normals, one for occlusion boundaries (depth discontinuities), and one that masks transparent objects

Google research: https://ai.googleblog.com/2020/02/learning-to-see-transparent-objects.html

Code: https://github.com/Shreeyak/cleargrasp

Dataset: https://sites.google.com/view/transparent-objects

3D Shape Estimation of Transparent Objects for Manipulation: https://sites.google.com/view/cleargrasp

fastai—A Layered API for Deep Learning

https://www.fast.ai//2020/02/13/fastai-A-Layered-API-for-Deep-Learning/

Complete documentation and tutorials:
https://docs.fast.ai/

Capsules with Inverted Dot-Product Attention Routing

New routing algorithm for capsule networks, in which a child capsule is routed to a parent based only on agreement between the parent’s state and the child’s vote.

Code: https://github.com/apple/ml-capsules-inverted-attention-routing

Paper: https://openreview.net/pdf?id=HJe6uANtwH

Matrix Compression Operator

https://blog.tensorflow.org/2020/02/matrix-compression-operator-tensorflow.html

Experimental API that facilitates matrix compression of a neural network's weight tensors: https://github.com/google-research/google-research/tree/master/graph_compression

Full documentation: https://drive.google.com/file/d/1843aNpKx_rznpuh9AmEshgAKmISVdpJY/view

GANILLA: Generative Adversarial Networks for Image to Illustration Translation.

Github: https://github.com/giddyyupp/ganilla

Dataset: https://github.com/giddyyupp/ganilla/blob/master/docs/datasets.md

Paper: https://arxiv.org/abs/2002.05638v1

The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)

https://jalammar.github.io/illustrated-bert/

Habr ru: https://habr.com/ru/post/487358/

BERT FineTuning with Cloud TPUs notebook: https://colab.research.google.com/github/tensorflow/tpu/blob/master/tools/colab/bert_finetuning_with_cloud_tpus.ipynb

Deep learning of dynamical attractors from time series measurements

Embed complex time series using autoencoders and a loss function based on penalizing false-nearest-neighbors.

Code: https://github.com/williamgilpin/fnn

Paper: https://arxiv.org/abs/2002.05909

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

Code: https://github.com/namisan/mt-dnn

Paper: https://arxiv.org/abs/2002.07972v1

Implementation of the BASIS algorithm for source separation with deep generative priors

This repository provides an implementation of the BASIS (Bayesian Annealed SIgnal Source) separation algorithm. BASIS separation uses annealed Langevin dynamics to sample from the posterior distribution of source components given a mixed signal.


Github: https://github.com/jthickstun/basis-separation

Paper: https://arxiv.org/abs/2002.07942

JAX-based neural network library

https://github.com/deepmind/dm-haiku

Haiku Documentation: https://dm-haiku.readthedocs.io/en/latest/

Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer

https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html

Code: https://colab.research.google.com/github/google-research/text-to-text-transfer-transformer/blob/master/notebooks/t5-trivia.ipynb

Github: https://github.com/google-research/text-to-text-transfer-transformer

ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Network

AdelaiDet is an open source toolbox for multiple instance-level detection applications.

Code: https://github.com/aim-uofa/adet

Paper: https://arxiv.org/pdf/2002.10200v1.pdf

Open Images V6 — Now Featuring Localized Narratives

Open Images is the largest annotated image dataset in many regards, for use in training the latest deep convolutional neural networks for computer vision tasks

https://ai.googleblog.com/2020/02/open-images-v6-now-featuring-localized.html

Open Images Dataset V6 + Extensions: https://storage.googleapis.com/openimages/web/index.html

Localized Narratives Example: https://www.youtube.com/watch?v=mZqHVUstmIQ&feature=emb_logo