Our team figured out how to optimize discrete abstractions of continuous-state systems with gradient descent. The solution lies in a smooth proxy for a simulation metric. An example state grid, resulting from our technique, is shown above.
Details below:
