Combining Deep Learning and Physics Models for Efficient and Robust Architectures