Using Ray RLlib with custom simulator
I'm very new to Ray RLlib and have an issue with using a custom simulator my team made. We're trying to integrate a custom Python-based simulator into Ray RLlib to do a single-agent DQN training. However, I'm uncertain about how to integrate the simulator into RLlib as an environment.
According to the image below from Ray documentation, it seems like I have two different options:
- Standard environment: according to the Carla simulator example, it seems like I can just simply use the
gym.Envclass API to wrap my custom simulator and register as an environment usingray.tune.registry.register_envfunction. - External environment: however, the image below and RLlib documentation gave me more confusion since it's suggesting that external simulators that can run independently outside the control of RLlib should be used via the
ExternalEnvclass.
If anyone can suggest what I should do, it will be very much appreciated! Thanks!
If your environment is indeed can be made to structurized to fit Gym style (init,reset,step functions) you can use first one.
External environment is mostly for RL environments that doesn't fit this style for example Web Browser(test automation etc) based application or any continual finance app etc.
- Using ranking data in Logistic Regression
- SHAP - instances that have more than one dimension
- Unity ML-Agents --num-envs get env ID
- XGBClassifier.fit() got an unexpected keyword argument 'early_stopping_rounds'
- How do I scrape a whole table when they all use the same class?, I can so far get the names only
- How is nn.Linear applied to a higher dimensional data?
- tensorflow:Can save best model only with val_acc available, skipping
- Keras: Difference between Kernel and Activity regularizers
- How can one run a Core ML model on macOS 10.12?
- How to fix the learning-rate for Huggingface´s Trainer?
- Roboflow Vs. Darknet for generating weight file and creating the model
- What is the difference between backpropagation and reverse-mode autodiff?
- Load Registered Component in Azure ML for Pipeline using Python sdk v2
- classifiers in scikit-learn that handle nan/null
- Encoding two categorial data present in same dataset in Deep learning
- Machine learning in q/kdb+
- Why do the sensitivity (recall) values differ between classification_report and precision_recall_fscore_support in a loop?
- How do you specify the bfloat16 mixed precision with the Intel Extension for PyTorch?
- mlflow doesn't autolog artifacts while logging images
- Choosing top k models using GridSearchCV in scikit-learn
- Calculating pairwise distances between entries in a `torch.tensor`
- Reusing a feature to split regression decision tree's nodes
- Fine tuning LayoutLmv3 using Cord-V2 dataset
- What does model.eval() do in pytorch?
- ElasticNetCV in Python: Get full grid of hyperparameters with corresponding MSE?
- Why is the accuracy for my Keras model always 0 when training?
- Polars - issues with performance - attempting to create a new dataframe per row
- Keras model.export() fails because of NoneType shapes in model
- Meta-feature analysis: split data for computation on available memory
- Single-headed transformer model, output and target tensor sizes don't match