gymnasium-http-api is an attempt at bringing back the same type of language-agnostic support. It mostly wraps the forked and supported Gymnasium library, with some endpoints specifically for making it easier to render and visualize the training and learning process.
Check out the README for some examples. Hope others find it useful!