Both state and action space are multidimmensional and continuous (but possibly discrete for certain dimensions)