Theory and Applications of Gradient Free Optimization in Physics